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ORGANIZATION OF THIS felBLIOGRA?aY . , • 

• # ■* 1 ■ ■ ' 

* • 

Three introductory chap,tetS' dlsci^fits evaluation and identify * " V 

relevant studies on three different perspectives — purposes for V • 

evaluation, focus of the "evaluations, and methods of evaluation, ' \ 

The^e studies are divided into a number of categories under 
each of the broad topics, an^ listecJ alphabetically by author if 
one is given; if there irs no personal author, they are , listed by 
title. . A single item is lifted' in as many categories as are deemed 
appropriate, and the ED (ERIC Document) or EJ (ERIC Journal)" number 
is indicated for each one. '\ ' 

The full biblloigraphic citation and abstra^ct or annotation are 
prd'vided foryeach citation In a single alphabetical listing in the 
main body^ol ^he Ijibl iography . As in the chapter listings, the 
arrangement jts by author or title. The only exceptions to this 
rule are sej^eral sets of reports or articles which would be widely ' 
separated in a strict alphabetical arrangemeni: . These are treated • 
as single units; in the chapter lists, only the first item is given, 

and in the bibliography, all of ^he related reports are listed with ' ^ 

the first one. Such sets are indicated in .the bibliography by a ^ 

vertical line in the 4>ef t margin. . - i 

Most of thQ documents with ED numbers are available in the ERIC 
microfiche collection, and single copies may be ordered from the 



ERIC Document R^roduct ion Service;^ see page 193 for details. Those 
items which sre^ not available from *EDRS are indicated by a single 
asterisk and another soured provided. Those which may be ordered^ 
from'^EDRS in microfiche but not in paper copy ar^ indicated by two 
asterisks, 

^^?hile citations with EJ numbers are not available through EDRS, 
these journals are widely available in libraries, and copies of 
articles from many of the Journals indexed in Cur^;-ent Index to Journals 
in Education (CUE) are now available through University Microfilms 
International. Information for ordering, including prices, is provided 
in ealch issue of CUE beginning with September 1977, and those journals 
for which this service is available c^re indicated on the list of titj^s 
covered which also appears in eac^ issue. 
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^v . ' ' \ INTRODUftriON . 

• ' This paiper represents an attempt to develop a useful sys dem for 

clas^fying #vfaluatioa studies of instructional technology pr«>grams, 

materials, and/or procedures. Both researchers and practitioners have 

noted the paucity of examples of actual evaluation studies that isight 

serye as. guides to other evaluation efforts. There are suspicions thatt 

while the quantity of literature on evaluation has been steadily increas- 

♦ 

ing, most of this literature is of a broad conceptual or advocacy nature, 
not altogether useful in advancing the effectiveness o^ evaluat;ion 
practice . At the very least, there seems to be a need for a compilation 
or catalog of actual evaluatibn reports from which insights about both 
evaluation methodology and t;he state of various educational and social 
programs might be gained. 

Similar frustrations exist for those seeking to study instructional 
technology. Here, too, the literature seems to be primarily advocacy 
(technology is the answer) -jLn naX^re. Some attempts have 'been made to 
synthesize- data about instructional technology, but the efforts to do so 
have been hampered by the absence of reported evaluation studies of 
instructional technology. - ' ^ 

Because the ERIC system is intended to be a depository for a range 
of materfals on education often not available from any other source, it 
seemed appropriate to examine the holdings of ERIC toi (a) determine 
what kind and how many evaluation studies of instructional technology 
were included in Ihe system, and (b) -to develop a way of classifying 
those studf^s in ways that might be useful to both the researcher and 
practitioner of evaluation and instructional technology. This paper 
reports, the results of efforts to accomplish these tasks. 



) The paper contains five sections- First, ^ procedures used in 
this inquiry are outlined. . An understanding o£ these procedures is vita^l 
to meaningful use^f the results. ' * 

The second section consists of citations frcjm ERIC classified accord- 
ing to the purposes for which ^evalijation studies were conducted. The 
third section contains citations of evaluation studies classified accord- 
ing to the primary Toe us of the stu4ies. The fourth /section classifies 
evaluation studies according to the methods purportedly used iij those^iv 
studies. The paper concludes with some remarks on additional work heeSed. 

-This paper must be viewed primarily as a reference work. ' -Nifi attempj 
have been made here to assess t^e quality or worth of the r^portk o^/evalu- 
ation studies cited. Such an assessment should follow. As a reference 
work, thi^ paper may be useful in making materials in ERIC related to 
instructional * technology and evaluation^ more a^^ssible to interested 
scholars and practitioners. 

Procedures 

* ' r 

Two procedures were undertaken concurrently by . the researcher: 

developing a preliminary classification schema for evaluation studies, 

« 

and searching the ERIC data base for reports of such studies. v 

The ERIC data base contains many documents and journal article 
citations included within the broad subject categories of evaluation and 
instructional tec hnology . A search using the descriptor "Evaluation"' 
voided 7142 citations; "instructional Technology" yielded an additional - 
3406 citations. In an attempt to obtain a manageable number of citations 
that would' reflect appropriate interactions between evaluation and 
teclmology, a computi'r search was un^dertaken in the following manner: 




ERIC 



two sets of terms were formed, onfe representing evaluation and the other 

representing instructional technology* The broad terms "Evaluation" and 

"Instructional Technology" werp themselves ellaniaated as( beUng too 

general; ERIC documents and articles tend to be indexed at a more specific 

« 

level of subject matter covered. 

The terms choaen for inclusion in the evaluatipri *e^ wejre: 

- Formative Evaltxation 
i # - Suimnative Evaluation 

^ Program Evaluation . ' 

- Equipment Evaluation 

A tot^l of 8361 citations was found in this set. Other terms cous*idered 
for the evaluation set, but liot included in the first search, were: 

- Evaluation 

- Course Evaluation 

- Curriculum 

- Needs Assessment ^ 

- Educational Ass^sm^nt 

Educational Status Comparison ^ 

- Peer Evaluation 

- Personnel Evaluation 

- Profile Evaluation • ^ 
Rel e vane e ( Ed uca t ion ) , 

- Student Evaluation . ' 

- Case Studies (Elducation) 
Evaluation Methods 
Evaluation Needs 

- "Evaluation Criteria 

- .Educational Accountability 

- Comparative Analysis 
Intermode Differences 

Terms chosen for inclusion 'in the instructional technology set were: 

- Computer Assisted Instruction 

- Instructional Media ^ 
Programed' Instruction' 

/ - Instructional Design 

Instructional Materials 

- Media Technology 

- Multimedia Instruction 

- Programed Materials 

- Individualized Instruction 

* . - Computer Managed Instruction 

Audiovisual Instruction 
Simulation 
. - Games 
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- Instructional iaproveaeat 
' - Instructional Innovation 

- Educational Television 

- Educational Radio 

- <3oaBttmication Satellites 

- Instructional Aids 

- Instructional Films 

- Television Curri(yiiltSn'\_ 
Children's Television 

- Educational Games 
~ Instructional Programs 

^ - Instructional Materials Centers 

■ - Ptograaed Texts • f 

- Media Selection * , 
* ' , . ( 

A total of 27,319 citations was found in this set. Other terms con- 

sldered for the instructional technology set, but not included in t?^ie 
search, were: 

- Instructional Technology 

- Educational Technology 

- Coxaputer Oriented Programs 

- Educational Development 

- Educational Research 

- Performance' Based Education 

- Curriculum Development 
Game fheory 

- Systems Approach 

- Systems Analysis 

- Audiovisual Aids ^ 

- Films 

- Phonograpji Records 

- Projection Equipment 

- Radio 

- Tape Recprdings 

- Autoinstructional Aids 

- Autoinstructional Methods 

- Audiovisual Qenters ^ 

- Resouupe Centers 
r Teaching Methods 

- Mass Media 
Learning Laboratories 

- Learning "Modules * 

- Educational Facilities 

- Instructional Aids 

- Slides 

- Visual Aids 
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^ In conducting the search, each of the descriptors in the evaluatio 
set arid the instructional technology set vas designated as 'a major 
descriptor • This served to exclude dociments and articles wherein e^lu 
ation or instructional technology were determined by the abstractor to be 
of only peripheral interest. , 

The next step was t'o identify those citations which included at 
least one major descriptor from the evaluation set and at ^ast* one major 
descriptor from the instructional technology set. While it is not essen- 
tial to this paper to describe technically the logic of the computer search 
itself, it is important to point out that the system eliminates multiple^ 
counting of any* single citation. That is, if a particular citation 
listed "Formative Evaluation" as a major descriptor (from the evaluation 
set^, and listed "Instructional Media" and "Programed Materials" as major 

X . 

descriptors from the ii^istructional technology set, the citation would not 
be counted as two citations. . ... 

The search yielded ^13 citations which contained at least one term 
from each set. A furthet restriction was then added: citatiorrs would be 
accepted only for those mi^terials announced in ERIC from January, 1970 - 
November, 1978 • The final number of citations to .be reviewed for inclusion 

in this study was 589., -* 

• I ' , ' ' " 

/ 

A printout, including \ED (ERIC Document) or EJ (ERIC Journal) number, 

author, title,* abstract 7""^^5d various other information, yas generated for 

■j^e 589 entries. xK^^xeseatcher reviewed this printout to eliminate^ those 

citations which appeared to fall outside the researcher ^ 5^ guidelines for 

i 

this study. The guidelines, while quite general, did result in the elimlna- 
tion of 132 citations. These citation.s were not, in the judgment of the 
researcher: evaluation studies, papers about evaluation problems related 
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to instructional technology, or al?out instructionaV^technology, In aoae 

cases, the decision to eliminatffe w^gs clear. In other cases, it was np^ so 

• *" . • » * ' 

clear that the citations' shotilia be ^eliminated; the researcher simply made 

a judgement. • • v ' . . * . , ^ 

' Following the eliminat^.on of the citations cited above, the researcher 
h^d a' Total of 457 citations^ to review. 

■ • . ft, 

Coricuri^ently vith steps 1,-3 as outlined above, the researchet 

developed. ^- tentative olassif i-cation schema to user-in analyzing the 

citations. Three broad* classifications >fere propJS^fe^d, togetHer with 

» # 

some categories within each classification. The schema is contained in - 
Figure 1- 

The intent was to analyze each , citation according to each of the 
three classifications. In sq doing, the researcher would, essentially be 
developing a different system according to which EHIC documents". might be ' 
retrieved. The system would permit the user to access examples oT 
evaluations done for different purposes, with different f oci and , With 
different methods. 

The classification system suggested, in Figure' 1, then, vas to < 
provide guidelines for the next step in the process. To facilitate th^is^ 
step, each citation was placed on a 5 |pc 8 index card, and assigned an 
identification number for this project- The researcher then began to go' 
through the ?ards,^to^^^rt citations into the categories suggested by ^ 
Figure 1. 

As this sorting * process began, however, difficulties emerged, ■ The., 
problem was that the classification schetme in Figure 1 assumed that the 
citations being analyzed represented reports of evaluation studies , 
Upon tuore 'Jcaref ul examination^ howeveV, this^ assumption was found to be 
erroneous. Consequently, the researcher, based on the substance of the 
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Purpose of the Evaluation 



1. Gathering data 

2. Gather ibig. da t;a 

3. Gathering dat^ 

4. Gathering data. 

5. GatWring flata 

6. Gathering data 

7. Gathering data 



to revise mAterials/jprograia 
to make materials/p:^ograa selectlon»^ 
to toake materials/pro^rais cpntinuatlon decisions 
to inform external ^udiences about performance 
to inforxa policy; deyeloiHttent 
to build theory or imake generalizations 
to sell or Justify materials/programs - , ' 



A mediuni 



Focus Of the t^^^atldtf 



<5> 



!• Radio 

- 2- Television 

3. Computer assi&ted instruction 

4. Computer managed Instruction 

5. Slide/ tape 
•6. Audio tape 

7. Programed instruction 

8. Audio-tutorial 
9t Satellites 

A system/program/process 

10; A series 

11. ^ A course ^ " 

12. - A pedagogical approach (e.g., 

* 

A development /evaluation process^ 

'-13. Instructional ^ development. 
14- Materials development - 
15. Evaluation methodology 



Individualized instruction) 



Methods Reportedly Used 

1. Survey ^^ ^ 

2. Ques-t Ibnnaire 

3. Interviews 

4. Observations 

5. Content ai)^15^sis 

6. Simulation 

7. Controlled experiment (research' design) 

8. Standardized testing 

9. ' Local testing 



Figure 1. Initial classification schema 
proposed for analysis of 
evaluation studies \ 
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C^tat^ons to be excluded 



Consists of citations whichi upon more careful revieWp do. not wfeet; 
' tnlftimal criteria for inclusion in /Study » or for which insufficient 
information exists by which classifications can he made* 



Scope/ focus inappropriate • ' 

Includes citations of studies or papers in which the evaluation is 
focfused op projects /programs not readily identifiable as instruc- 
tional technology. * * ' ^ 

Method critique 

Consists of papers or studies which are either critiques of a 
methodology or technique, specification of a plan for evaluation, 
or a list of evaluation criteria, but are not repprts of ^evaluation 
studies. • ' 



Analysis of a study ^ 

V 

Includes papers or reports which ^analyze evaluation studies foif 
purposes* of drawing inferences about design, methodology, etjc. ; 
attempt to aggregate/sunBuarize data across evaluation studies; 
respond to evaluation studies; or summarize activities of an 
evaluation institute or center. 



Conceptoal papers 

Includes papers 'of a general conceptual or theoretical nature 
related to evaluation of instructional technology , ^ but not ^> 
critique of a particular methodology. Includes attempts to 
construct models of evaluation. 



V 



Evaluation studies 



Includes papers or.- reports of actual evaluations of instructional 
^ . technology 
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citations being reviewed, developed yet another way of classifying the 
citations. 

The 4.ntenaedl5te classification system consisted of six caijegorifes,. 

outlined in' Figure 2. The figure contains a brief ,eacplanati6n of 
*■ > " • ■ . ■ ■ * 

each category. Sorting the citations into these categories yielded the 

■ ■ . • * ' * 

following distribution: ' ^, * 

Citations to be excluded 33 

Scope/focus inappropriate ^5 

Method critique ^3 
Analysis of a study 

Conceptual papers 66 

Eval;iation studies 224 

In addition, there were 13 instances in which multiple citations existed 

for a single evaluation study. Those multiple citations were combined 

where appropriate, and treated as a single citation. 

While the categories "method critique," "analysis of a study," and 

; • - ^. _ 

"concep-tual papers" are not germane to the central purpose of this 
inquiry, the citations in these categories do contain ^material of poten- 
tial interest to the student or practitioner of evaluation. Appendices 
A,^B, vand C contain the accesM-on number, authorCs), and title of the 
citations in each of these categories. 

Following this step, the researcher sorted the citations (N-224} of 
the evaluation, studies according to the three major classifications 
included in Figure 1. The results of these sorts are contained in the 
sections that follow. 



■{ ■ ■' ' ■ ■ • 

PUliPOSES FOR EVALUATIOir 

Evaluations aro^done for many reasons • Some evaltiatB because they 
are told they must . Those who provide funds for projects often Insist 
that thpse projects be evaluated as one of the conditions for receiving 
funds, , Others evaluate because they hope to justify a program or product* 
still, others evaluate because they hope to gather data needed to improve 
a program or product. 

In this study, the researcher sought to identify the primary purposes, 
either stated or Implied, for each evaluation sti^dy included in the search. 
Seven categories were identified.' The number of citations relevant to 
each category is also indicated below,. Six citations could not be cate- 
gorized due to insufficient data. *^ 

Category 1: , Evaluation for revision (21^tations) 



\ 



The purpose of evaluations in this category is primarily ^ 
to collect and reporf data useful in revising/changing n 
• materials, programs, or^/procedures. Th%se studies are \\ 
generally not intended to gather or make judgments about 
the worth or value of the program being evaluated. 

Category 2: Evaluation for selecting ' ' (27 citations) 

The purpose of evaluations in this category :^s primarily 
to gather data that enable deodsion makers to make more 
informed selections of programs or materials for use in 
their settings. Many of the studies conducted for this 
purpose attempt to delineate the commonalities and 
differences among virioiis approaches to the same problem 
(e.g*, selection of competing individualized instruction 
systems) . 

Category 3: Evaluation for termination/continuation (24 citations) 

The purpose of evaluations in this category is, primarily 
to gather data useful in making decisions about terminating, 
continuing, or expanding a^program, project, or the use of 
-particular instructional materials. 
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^ 'Category 4 Evaluatton for reportiiig status (118 citations) 

The purpose of evaluations in this category is primarily 
to report on the outcomes and effectiveness o^ ptograms or 
isaterialsy lobst often for use by people or agencies external 
to the project. In ©any respects, thcrse evaluations ar^ dona 
/ to provide general information rather than data ^r any 



particular decision, , The results ^f the evaluation may be 
used in a variety of ways by different .audiences, but the 
initial intent of the evaluation is general information. 



Category 5: Evaluation for policy development ^ ^ citatioiis) 

The purpose of evaluations in this category .is primarily 
to gatljer data useful in making or analyzing policy decisions ♦ 
decisions that ;are generally applicable beyond the specific " V/ 
progtam or matjitrials being evaluated. Such evaluations may 
focus on the Aggregation df data and its application to , 
particular policy decisions. 

Category 6: Evaluation for generalization or 

theory building . (13 citations) 

The purpose of evaluations in this category is primarily 
to build generalizations or theories about programs or 
procedures. These evaluations- tend to include syntheses 
of findings from multiple evaluation studies, and attempts 
to relate these findings to existing theories or concep- 
tualizations. Some argue that such evaluations are better 
labeled research ; nonethel'ess , *some studies tailed evalu- 
ations seem to be done for this purpose. 

Category 7: Evaluation for sales '(2 citations) 

The purpose of evaluations in this category is primarily 
-to 'report data supportive of -a program or materials for 
the express purpose of selling those materials to consumers - 
Thi§ category might be thought of as evaluation for marketing. 



The majority of studies included in this inquiry fell into Category 
4: Evaluatior^ for reporting status. In some respects this is not sur- 

prising, since most • evaluations purport to be studies of the effective- 

\ 

ness of a given program or materials. Nonetheless, given the fact that 
instructional technology tends to focus on development processes as part 
of i|2S domain, it might have been predicted that more st^udies would be 
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placed in Category 1: Evaluation for revision* The results of 'this 



inqulp; tend 'to support the suspicion that "fypst formative evaluation 

efforts are not reported in any formal sense, hl^t operate on a more 

informal basis, * . ' " 

Again, it must be emphasized that the classification of studies 

according to evaluation purpose was not done on the basis of how the 
studies were actually used, but on the basis of implied or explicit 
puiT50se as determined from titles and abstracts. 



4 . 



Accession number, author (s)^ and title of studies classified by 



•^valuation purpcipe follow. 
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Purpose Category 1: Evalxiation for revision 



Author (s) 



Title 



Accession No, 



Baker, Eva L. 



Branson, Robert K. 



Dickerson, Larry R. and 
Roberts, Ralph R.^^r. 



Gaddis, G. Warren 



Hall, Keith A. -anc^ others 



Practicum for Instructional 
Developers. Final Report. 

Formative Evaluation Procedures 
Used in Designing a Multi-Media 
Physics Course, « 

The Effectiveness of Prepackaged 
Instructions for the Inservice 
Training of Rehabilitation 
Counselors. 

Evaluation of Televised Elec- 
tronics Instruction Program. 



In^rvice Mathematics Educa^tion 
for Elementary School Teachers- 
via Computer-Assisted Instruc- 
tion (California) , Interim 
ReDort . 



ED098266 



EDO50140 



EJ108966 



ED086186 



ED076043 



Harlen, Wynne 



A Critical Look at the Classi-t 
cal Strategy Applied to Forma- 
tive Curriculum Evaluation. 



EJ131787 



\ 
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Author (s) 



Title 



Accession No. 



Heflin, Virginia A. and 
others 



Hsia, Jayjia and 
Strand, Theresa 



Kaufman, Maurice 



Laosa, Luis M. and others 



y^Lewis, Richard F. 



The Fonaative Period of, LISTEN 
LOOK LEARN, A Multi^fedik ' 
Coroainlcation Skills iSystem. 



ED049019 



ED129889, 



WTTW-ESSA Television Pilot , 
"TCR '77,": Formative Evalu- 
ation., ^ 

The Effect of ' the DISTAR Instruc-- ED110171 
tipnal System: An Evaluation of ; 
the 1972-1973 Titl€' X Program of 
Winthrop„ Massachusetts . 



An Evaluation -of Son-Formal ^ ED116881 
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Cos^^uter-Based Resource Units. 

The Word Problem Program: 
Sumaative Evaluation* 

Evaluation of C.A-I, as Used 
by Various Handicaps* ^ 

The Firsit Year of Sesame Street: 
A Summary of Audience Surveys. 
Final Report, Volume IV of V 
Volus^. 

1976-77 TXCCIT Project. . Final 
Report. 

Evaluation of Learning 100 5 
AB6 Center, White Plains, N*Y. 
January Junf , 1968. 

Science Programming and the 
Audiences for Public Tele-- 
vision: An Evaluation of Five 
Programs in the NET '^Spectrum" 
Series, 

Comprehension of Television 
Programming Designed to Encour- 
age Socially Valued Behavior in 
Children: Formative Research 
on "Sesame Street" Programming 
with Social and Affective Goals. 

An Evaluation of the Mulligan 
Stew Television Series for 
Extension Service, 0SDA. 
Volume I: Executive Summary. 

Evaluation of the Manitoba 
Schools Computer Network. 

Project Turnabout, School Year 
1975-197^. 



Accession No. 
ED056*78 ' ' 

ED073589 

ED113212 

ED136775 

EDOA7824 



ED14S430 
H)036718 

ED034933 



ED122863 



ED134618 



EJ119715 



ED1426A0 
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Title 



■I 



Accession No. 



Singer^ Frank A. 



Self-Instructional Materials 
for Topics In Elementary 
Accounting — A Means to the 
Demonstration of Pay--Offs • 
from Individualizing Tiae-to- 
Complete* Final Report. 

State Wide Dem^nstiration- 
Bisseminatlon of Drug EdUca* 
tion Materials through a^ ^ ^ 
Training Center and Local 
School Workshop Experiences, 
Narrative Evaluation. 



ED082291 



ED151649 



Stefanides, Gilbert Albert 



St ice , James 



Tatham, Elaine L. 
and others 



Thompson » John F. and 
others 



Trojcak, Doris A. 



An Evaluation of Achievement ED127613 
and Attitudes of Students and 
Teachers Using an Individualized 
Spelling Approach* 

Seventeen PSI Projects at the ED108665 
University of Texas at Austin.^ 

A Simmary of ^the Formative EDO86180, 
Research Conducted on Pilot 
Shows 02 and 03 Produced by 
Bilingual Children's Television. 

■ ' ^' 

Evaluation*of College Learning ED110141 
Center Instruction in Six Sub- 
ject AreWr^pfing 1975. 

Evaluation of Educational Tele- ED04A639 
vision in University Extension 
Youth Programming. 

Topical Modules in Secondary ED107478 
Mathematics. Final Project 
Report . 

Training in Prograsiffiing Ins true- EJ100017 
tion and Student Achievement. 



VanWart , ;Geraldine 



Vaughn, John W, and 
Duncan, Robert C. 



Carrascolendas: Evaluation of ED092089 
a Spanish/English Educational 
Television Series within Region 
XIII. Final Report, Evaluation 
Component . 

Evaluation of Merrimai:}^ Educa-- ED114367 

tion Center *s Project League 

1973. 
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Author(s) 



Title 



Accession No. 



Vinci, Thcmaa, G. and 
DeVica, Christina 



Weinstein, Sanford 



Weiss, Jasies 



Williams, Frederick and' 
Natalicio, Diana S. 



Williams, William Watts 



Wolf, Judith G. and 
Sylves, David 



Wolvek, Joseph 



Wood, Dean A, 



Zachert, Martha Jane K, 
and Pantelidis, Veronica 



kh Eviauat^on of the State ED059881 
Urban Education Program 
'^ving Science Center** 
District 10, New York City 
Board of Education. • 

Vocabulary Developaent Project. ED059838 
Evaltiation Report 2." 

Vocational Campus Muitiaadia * ED079476 
Learning 'I^aboratory Prograa- 
£xtensioi\. VE& Project Ntiaibar 
72-2-179 Hnal Report. 

■ » * ' ■ 

Diagnostic; and Remediation £0136487 
Program to ^Ameliorate the , 
Reading Disabilities of JHS CRMD 
Pupils, Febhiary-June, 1975* 
Evaluation Report. ' •> 

^ \ 

More Advanced Reading Develop- ^ ED142631 
ment, 1975-76 School Year* 

Evaluating Carrascolendas : A ED062367 
Television Series for Mexican- ; 
American Children » 

An Experinfelntal Investigation ED052dl5 
of Individualized Instruction 
in the Teaching pf Quantitative 
Physical Science; 

Evaluation of a Bilingual Tele- ED103511 
vision Series Villa Alegre; 
Final Report. 

Bread and Butterflies: Evalu- ED1U493 
ation of the lEBN-DPX Iowa 

Educational Broadcasting Net- ' . ; - 

work — Department of Public 
Instruction 1974-75 Inservlce 
Training Workshops. 

The Development and Diagnostic ED065303 
Evaluation of the Monte Carlo 
Integration Computer as a 
Teaching Aid. 

SIBE: A Sequential In~Basket , ED056469 
Exercise Technique. 
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AuthorC*) 



Title 



Accession Ho, 



Purpose Category 5; Evaltiatioa to inform policy developa^nt 



KaufiBan, Maurice 



The Effect of the DISTAR In- 
structional System: An Evalu- 
ation of the 1973-1974 Title I 
Program of Winthrop, Masaa^ 
chusetts. 



ED110170 



Martin, Thomas H. 
and others 



A Poli-cy Asses^nent of Prior- 
ities and Functional Needs for 
the Military Computer-Assisted 
Instruction Terminial. 



ED116672 



Petty, Bruce Alan 



Plnsky, Paul D. 



Media Implementation through ED049598 
Teamed Supervision. Evalu- 
ation: Title Three, ESEA. 

f 

An Evaluation of Selected In- ED070290 
structional Media Programs in 
^nsas Colleges and Universities. 

Achievement Monitoring of Indi- ED092175 
vidually Pac^d Instruction, 
Final Report. 



Purpose Category 6: Evaluation to build theory 



Amarel, Marianne and 
others 



The Introduction of Innovative 
Instructional Systems: Imple-- 
mentation and Program Evaluation. 
Section 1* The Practitioner: 
Selection, Training, and Pro- 
gram Evaluation: Section 2. 
Degree of Implementation and 
Classroom Observation. 



ED118619 



Fehrle, Carl C. 



Individualized Prescribed In- 
struction: A Critique. 



ED041A62 



Felsenthal, Norman A. 



Sesame Street: 
by Surrogate. 



Socialization 



ED105987 



Fowles, Barbara R. 



Black and White and Read All 
Over: Acquiring Literacy in 
Two Media. 



ED126941 
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Author(8) 



-Title 



Accasslon No, 



Gailltis. Maris M. 



Gohring, Ralph and 
Chiareloct, Leigh 



Jacobsen, David A. and 
Cerlach, Vernon S. 



Klauameier* Herbert i. 
and others 



The Costs of Information 0)073706 
Retrieval Television. A Case 
.Study in tha^Cost-Effective- 
ness of Educational Hedia. ' < 

The Use of a Siimlation Game ED137362 
to Assess and Influence the 
Leadership Styl^ of Elesaen- «, 
tary Princip>als: The Princi- 
pal Case. 

A Comparison of the Effects of ED074773 
Textual and Televised Modes of 
Instruction in Teacher, Educa- : 
tion. ' ^ . 

A Report on the Utilization of ED134559 
Individually Guided Motivation. 
Technical Report No. 388, 



1- 



f 

i 



Leinhardt^ Gaea 



Program Evaluations An Empiri- 
cal Study of Individualized 
Instruction. 



ED131092 



Olien, N* and others 



Ronan, Franklin Delano < 



A Systeoia Evaluation of a ^ ED122794 
Purposive Message: The 
"Mulligan Stev^' ETV Project. 

A Study of the Effectiveness of ED072615 
a Computer When Used as a Teach- 
ing and Learning Tool in High 
School Mathematics. 



Suppes^ Patrick and 
Morningstar, Mona 



Yamarooto, Toru 



Computer-Assisted Instruction ED070246 
at Stanford, 1966-68: Data, 
Models, and Evaluation of the 
Arithmetic Programs. 

Seaame Street around the World: EJ139255 
The Japanese Experience* 



Purpose Category 7: Evaluation' to sell or justify materials 



Buffer, James J. and 
others 



A Junior High School Industrial 
Technology Cutriculum Project: 
A Final Evaluation of the Indus- 
trial Arts Curriculjam Project 
(lACP), 1965-1971, 



ED054 389 
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Author 



45^ 



Title 



Ross, Harvey t« 



I 



•An EyaloatiQQ oi- Che Effet-- ED643S30 
Tiyeneis of the^len 'Te^qij'- > • V T 
lag Machine at "fclie , Fed eWal . . ' 
torrectional jIus titu tioh , ' 
Lompoc, California^ ,Finai$ 
.Report* . 



Purpose Category 8; - Miscellaneous 



Doyle t Claries P« and 
Fen ton, porpthy 



Ftiedman, Morris 
Herbert, Budd 

1 

\ 

Kline. James A. 



Mattfcews, Bonny e 
'Peerson, Nell , 



Teacher InvpXveinent' as Co*i , 
lated to Degree of Acc^j^ta^ce t 
of In-Service Television . J 



Programs. 



• New York City's Decentralized 
Xed la Program, \^ 

The N^ew Town Gaine: Ah Evalu-- 
ation Based ,on Instructional 
^ Experience* 

V ' ■ ' ' ■ *■ ■ ' 

Evaluition qf a^ Multimedia 
Drug* Sducation Program. ^ / " 

. Traininlg More Employees for- 
X Less Money. ^ • , 

. ' ■ \ . 

Two American Studies oh literr / 
ac3ii Through Television: A Y 
Televis^jOn Experiment in^^ ^ 
Alabama, 





^066205 
EJ1*724 



EJ028469\^ 




1 
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FOCUS OF THE EVALUATIONS ^ 



iving identified various purposes for conducting evaluations of instruc 
tional technology programs and materials,, the researcher sought to identify 
L the focus of thesft evaluatloiisy That is, what kinds of media or procedures 
were being evaluated? This class tficatdon should be useful for those people 
; peeking information about the results of evaluations directed at« a certain 
*• kln^i of medium or pedagogical strategy, ^nd for those looking for methods / 
qsefyi in evaluating a given medium* [■ , 



• 4 4C 



y ^'-jTh^ categories in this classification were derived from the citations 

' th6?9^elv6s. Once again, the researcher reviewed the title and abstract of 

V each citatiph previously judged to be a ireport of an- evaluation Study . The 

' * .\inlt'ial Aass£i*;^cation scheme for focus in Figure 1 was 'modified as a" 

\^ result of a review pf the citation abstracts. 

./ ^ Wi^ty-elg^ (I'^y of the citations did not contain sufficient informa- 

tion ta^ determine the focus of the evaluation study. Sixteen categories 

^re^ included th^ /'Focus" classification. These categories, together 

\'\ witl^ the (^umbeir of citsktlpns^ermane' to each, are as follows: • 

Category Radio ^ ^ 

\ ^ Category 2 : ' tl^levigion/vldeo * 

. * , ' Category 3; ^ ComputeS: assisted instruction 

, Category- 4: ; Qomputer managed instruction 

' ^ Category 5: ^ Slide/tape programs- 

♦ \ Category 6: AuciiotapB programs 

^ Category- 7: Prograjmned instruction 

1 Cat^gc^ry 8: Audiq-tUtorial > 

' • ^Category' Satellites ^ 

.♦Category 10: Print (texts , etc-) ^ 

Category 11: Simulation/ games 

Category X2i Use pf computers for administra- 

\ \ . tion/ evaluation V 

Category 13: Multi-media programs (other 

_tH^n slide/t«pe) 



Category 14 
Category^ 15 
Category 16 



Filia 

Mlcroficihe , • 
Individualized instrucHon pro-* 
grams (e.g.^ IPI , IGE/^etc;^) 



( 1- 


citation) 


(51 


citations) 




citations) 


(3| 


citations) 




citations) 


( 1 


citation) 


( 6 


citations) 


( 3 


citations) 


( 5 


citations) 


( 6 


citations) 


(12 


citations) 


( 4 


cltat ions) 


(21 


ci tat Ions) 


( 3 


citations) 


( 1 


citation)* 


(37 


citat ions) 



Television, comptiter-^-assisted^ instruction,", individualized instruc- 
tion sy^e:ps,. and ^'d.rious multi-media programs' br. packages ■ dominated the 



'"■JO- 



if* 



focus of the evaluation studies incllided in t,his review. Sesame Street 

ana The El-ectric Coinpany were the television programs most freq[.uently evalu- 



:ed, as might be expected from the vast population these programs reach. 
PI^TtKjtended to be the focus of many of the CAI programs being evaluated. . 

IPX and were the fotpus of many evalji^tion studies ass well. ; 

While cauts4^n musf be exercised in^drawing conclusions frqm the 

di^stribution of evaluation studies across focus areas» it is tempting to 

> .'' ' ' ' ■ ■ ' ^ ; ' 

infer that attention during the late 1960's and early-to*-middle 1970*s has 



been given primarily to high-technology educational approaches within the 
instructional technology community. This distribution may reflect little 

more than the distribution of available R&D funds > and the relative - 

< 

costs of utilizing the various technological approacjies at our disposals. 
Whatever^ the reasons, the focus of evaluation efforts, as. reflected in 
studies of instruct ional technology in EI^JC, is clear. 

Author(s), title, and accession numbers of citations classified by 



evaluation focus follow. 



Author (s) 



Title 




Focus Category 1; Radio 



Vocabulary Development Prog ect 
Evaluation Report 2, ^ 



ED059838 



* Focus Category 2; Television 



Acller, Leta McKinney 
and others 



Evaluation of^ Programmed In- 
struction Techniques in Medical 
"interviewing. J'inal Report, 
June 15, 1966 to June 15, 1968. 



ED059345 



0 
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Ali^ Stephen' A. and 
Stegeaan, Wllliaa H., Eds. 



\ 



Ardl, Dana B. 



To Eatablish, Operate aod 
Maintai& Suppl«mentary Educa- 
. tional Servlceat Instmc-^ 
tionai Xelevlaion Exparlence 
Developmeot aad ptatrifeutipn. 
An Evaluation of San Diego 
Ar^ Ins true tional Television 
Authority Educational Prograjs 
Activities: Septeaber 1, 1968 
to June 30, ^ . 

New Avenues of Teachiiig Re- 
sotirces — Sesame Street Pro- 
gras^» for the Mentally ^Retard-* 
ed Child. " ^ 



ED038031 



EDli9197 I 



Ball, Samiel and 
Bogatz, Gerry Ann 



Bally Samuel and 
Bogatz» Gerry Ann 



Sail, Samuel and 
others 



Reaeareh on Sesame Stree^ \ ED068155 
Some Implications for Comp«n- 
satofy Education. . ' 

Sesame Street Summiative Re- ED057914 

search: Some Implications 

for Education and Child 

Development. • ' 

The First Year of Sesame ED047823 
Street-: An Evaluation* 
Final Report, Volume III of ^ 
V Volumes. 



Ball, Samuel and 
others ' 



Ball, Samuel ,and 
others 



Hunger, Marianna 



Carpenter, C, R. and 
othens 



Reading with Ttelevision: An 
Evaluation of the Electric 
Company. A Report to the 
Children's Television Work- 
shop, Volumes 1 and 2. 

Reading with Television: A 
Follow-Up Evaluation of t he- 
Electric Company. 

Two American Studies on Liter- 
Through Television: Opera- 
\n Alphabet in Florida. 




Educational and Instructional 
Television Facllitl^ Evalu- 
ation: -Preliminary Practical 
Procedures. 



EDO? 317a ^v^^" 



ED122798 



.EJ02847O 



ED037101 
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Author (s) 



Title 



Accession No, 



Doyle, Charles P, and 
Fen ton, Dorothy 



Felsenthal, Norman A. 



Fisher, Kathleen M. and 
others 



Flaugher,, Ronald L. and 
Knapp , Joan 



Fowles, Barbara R« 



Fruchter, Dorothy A. and 
Higginson, George K. 



Gaddis, G. Warren 



Gail it is, Maris M. 



Hezel, Richard T; and 
Neubert, Nancy Malecek 



Detennining the Effects of 
"JDevelopiiig Readiness for / 
Pre^School Children via 
Jelevision'^i A Title III 
Project. 

Teacher liovojlveffleat as Corre- 
lated to Degree of Acceptance 
of In-Service Televiision 
Programs. 

An Evaluation of the Instruc- 
tional Television Program 
Basic Education: Teaching the 
Adult. 



Sesame Street, 
by Surrogate. 



Socialization 



The Effectiveness of Video- 
Autotutorial Instruction for 
a Very Large Enrollment tJniver- 
sity Course in Science. ' 

Report on Evaluation Activities 
of the Bread and Butterflies 
Project. 

Black and White and Read All 
Over: Acquiring Literacy in 
Two.^Media. 

An Evaluation {Import of Project 
INTERACT: A Teacher Inservice 
Training Course on Career Educa- 
tion Using Two-way TV in Texas 
t^o Several Groups Simultaneously. 

Evaluation of Televised Electron- 
ics Instruction Program. 

The Costs of Infonnati'on Re- 
trieval Television. A Case ' 
Study in the Cost-Effectiveness 
of Educational Media. 

The Allegheny Educational Broad- 
cast Council; Instructional 
Television in Central Pennsy- 
vania. 



ED093484 



EJ051764 



ED128579 



ED105987 
ED143694 



ED097921 



ED126941 



ED110O76 



ED086186 
ED073706 



ED156168 
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Author(s) 



Title 



Accession Ko. 



. Hornik, Robert C. and 
others 



Hsia, Jayjia and 
Strand, Theresa 



Jacobsen, David A. and 
Gerlach, Vernon S, 



Klein, Stephen P. and 
others 



Television and Educational ' .33084810 
Reform in El Salvador. 
Final Report. 

WTTW-ESSA Television PUot, ED129889 

"TCR •7?»": Formative 

Evaluation. 

A Compariaon of the Effects of ED074773 
-Textual and Televised. Mod«« of 
Instruction in Teacher Educa- 
tion. 

A Progress Evaluation of Four ED109260 

Bilingual Children's Jeievision 

Shows. 



Laosa^ Luis M. 



Car r as co 1 enda s : 
Evaluation* 



A Formative 



ED090968 



Liebert, Roland J. 



Hays, Luberta ajid others 



Mock, Ronald L. and 
others 



"The Electric Company** In- . ?D094775 

School Utilization Stydy* 
Volume Two: The 1^972--73 School 
and Teacher Surveys and Trends 
since Fall 1971. 

• 

An Evaluation Report on Vege- ^ ED12020A 
table Soup: The Effects of a ' 
Multi-Ethnic Children's Tele- ' 
vision Series on Intergroup 
Attitudes of Children. Precis . 
and Overview. 

Northern California Postgraduate EJ015978 

Medical Television: An^Evalu- 

ation. 



/ 



Mohrmann, Jeanne W. and 
Wise, Wilmer E. 



Nolan, Jeanne and 
Gross, John 

0^ Bryan, k. G. 



Evaluation of Closed Circuit 
Educational Television in 
Delaware: Emphasis on Utili- 
zation, Program Serld^ Content, 
and Commitment. Preliminary 
Report. 

Mulligan Stew: An Evaluation 
of the Television Series. 

Monkey Bars Research Report. 
Report No. 46. 
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ED038033 



ED105889 



•ED0^897^ 
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Author(s) 



Title 



Accession No< 



0* Bryan, K. G, and 
others 

Olien, C. fJ. and others 



Peer son, Nell 



Radlick, Michael S. and 
O'Reilly, Robert.?. 



Kockxnan, Saul and 
Auh, Taiksup 

Samuels, Bruce, Coinp, 



Quest into Hatter. 
.Report, 



Shapiro, Bernadette Nelson 



Shapiro, Sydelle Stone 
and others 



Finia 



A Systems' Evaluation of 9 
Purposive* Message: "The 
Mulligan Stew" ETV Project, 

One Nation, Indivisible? A 
Suamary of Evaluation Findings. 

Two Anerican Studies on Liter- 
acy through Television; A 
Television Experiment in 
Alabama . 

Learning from Television: A 
Television Based Learning 
System as a Capable. School 
Resource, 

Formative Evaluation Report of 
Self Incorporate^ Progr^s. 

The First Year of Sedame Street: 
A Summary of Audience Surveys* 
Final Report , Volume IV of V 
Volumes • 

Science Programming and the 
Audiencea for Public Televi-- 
sion: An Evaluation of Five^ 
Programs in the NET "Spectrum" 
Series. 

Comprehension of Television Pro- 
gramming Designed to Encowrage 
Socially Valued Behavior in 
Children; Formative Research on 
"Sesame Street" Programming with 
Social and Affective Goals. 

An Evaluation of the Mulligan 
Stew 4-H Television Series for 
Extension Service, USDA. 
Volume I: Executive Summary • 

A Summary of the Formative Re- 
search^ Conducted on Pilot Shows 
02 and 03 Produced by Bilingual 
Children's Television. 



EDU6690 



EDI 22794 



ED 045460 



EJ028469 



ED129254 



ED119712 



ED047824 



ED0349:S3 



ED122863 



ED134618 



ED086180 
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AuthorCi) 



Title 



Accession 



4 



TlK>Bp«on» John F. 
and others 



Valencia, At llano A. 



VanWarty Geraldine 



William^, Frederick and 
Natalicio, Diana S. 



Evaluation of Educational . ED044639 
TelevidioQ In Univeraity 
Extanaion Youth FrograattiBg^ 

Tlja Relative Efftectivea««» ED050615 

of Three Video Oral English 

Instructional Conditions for 

Illiterate or Dndereducated 

Non*»English Speaking Adults ^ 

Spiinish Speaking Adults. A 

Report of Statistical Findings 

and Recoanendations Sased on a 

Field Testing Study. 

CarrascoXendas: Eyaluatlon of ED092089 
a Spanish/English Educational 
Television Series within Region 
XIII. Final Report. Evalxia- 
tion Component, 

Evaluating "^CjH^as'colendas : A ED062367 
Television Series for Mexican- 
American ChUdban, 



Williams, Frederick ' 
an4 others 



Wolf, Judith G. and 
Sylves, DaVid 



Wolvek, Joseph 



YamaiDoto, Toru 



Carrascolendas: National Evalu- ED078679 
ation of a Spanish/ English 
Educational Television Series. 
Final Report. ' . 

f 

Evaluation of a Bilingual Tele- ED103511 
vision Series Villa Alegre:, 
Final Report. 

Bread and Butterflies: Evalu- ED114493 
ation of the lEBN-DPI Iowa 
Educational Broadcasting Net- 
work — Department of Public 
Instruction 1974-75 Inservlce ^ 
Training Workshopsl 

Sesame Street around the World: EJ139255 
The Japanese Experience. 



Foc us Category 3:' Computer assisted Instruction 



ERIC 



Amarel, Marianne and 
athers 




The Introduction of Innovative ED118619 
Instructional Systems : Imple- 
mentation and Program Evaluation;' 

Section U The Practitioner: Se^ 
lection. Training, and ProprRi^ Eval- 
uation. Section 2. Degree of Imple- 
mentation and Classroom Observation. 



39 



Author (t) 



Aoastasio, Ernest J. 



Ti tle 



Survsy o£ Instructor Activi- 
ties and Attitudes. 



I. 



Accession No* 



ED072071 



\ 



Ansstssio, Ernest J. snd 
Aldermen, Donald L. 



Brightman, Richard W. . 



Caldwell, Robert M. 



Evaluation of the Educational 
Effectiveness of PLATO and 
TICCIT. * 

♦ 

Computer Assisted Instruction 
Frogras for Pol left Training. 

lAS^rkcy Pevelopmeat Using A. 
PrdV^axoned Text and Computer 
Assisted Instruction. 



ED 088934 

ED06785S 
£2)089216 



Culp, George 



Dallisan, Brian E. And 
others 

De.ihl, Ned C. and 
Zeigler, Ray H. 



Dunn, Alex and others, 
Eds. 



Durvard , M. ^ Lyhne 



Ford, JohnD., Jr. and 
slough, Dewey A. 



Hall, Keith A. and others 



Computer Aided Learning Pro- ED129281 
ject: Report, Trial 3. 

Computer-Assisted Instruction EDO72^30 
in. Undergraduate Organic 
Chemistry: Desi^, Applica- 
tion, and Evaluation. Tech- 
nical Report 10. 

Evaluation of PLATO IV in ED153638 
Vehicle Maintenance Training. 

Evaluatitrd^of Computer-Assisted ED067897 
Instruction in Instrumental 
Musicianship* Final Reports 

Computer-Assisted Instruction ED100361 
Program. A Three Year Report 
Covering July 1, 1971 through 
June 30» 1974, 

The fivaluatlpn of Computer- EP088919 
Based Instruction in Vancouver 
Secondary Schools • 

A Feasibility Study of Computer ED095923 
Assisted Instruction in U. S. 
Army Basic Electroaics Training. 
Fiqal Report. 

Development and Evaluation of ED042950 
Computer Assisted Instruction 
for Navy Electronics Training. 
1. Alternating Current Funda- 
mentals « 

Inservice Mathematics Education ED07.60A3 
for Elementary School Teachers 
v:^ Computer-'Asslsted Ins^truction ^ 
(C^ifornia). Interim Report. 



40 



47 



ERIC 



Author(t) 



Title 



Accession No. 



Klecks» Joseph A. 



Lasater^ Ksry Beth 



Initial Evaluation of Opera- ED041977 
tioo Wordpower . 

An Overviesr of Chanute EDW0776 
Lessbna. ' ^ 

Design and Evaltiatipn of a ED073613 
CAI Prograa in Chemical Equili- 
briuii. Technical Saport Huaber 

8. ■ ' . 



Longo, Alexander A. 



'Lbngo, Alexander A. and 
Giuntl, Frank £. 



Lyslak, Fae and others 



McKeown, James C. 



Mart In, Thomas H. and 
others ^ 



A Suonative Evaluation of Coa- ED074699 
imter Assisted Instruction in. 
U. 5. Arajr Basic Electronics 
Training. Technical Report. 

A Sequential Evaluation of ED082472 
Computer Assisted Instruction 
in U. S. An^ Basic ^ectronics 
Training. • 



CoiBputer Assisted Instruction. 
1975-76 Evaluation Report. A 
Title I Pxtegraa. Kevised. 

PLATO Im true t ion for Elementary 
Accounting. 

A Policy Assessment of Priori- 
ties and Functional Needs for 
the Military Computer-Assisted 
Instruction Terminal. 



12)140495 



ED123467 



ED116672 



Mltzel, Harold E. and^ 
others 



Murphy, Richard T. and 
Appel, Lola Rhea 



Paden, Donald W. and 
others 



A Comxaonwealth Consortium to ED059604 
Develop, Implement and Evaluate 
a Pilot Program of Computer- 
Assisted Instruction for Urban 
High Schools. 

Evaluation of /the PLATO IV ED146235 
Computer-BaseoEducatlon Sys- 
tem in the Community College. 
Final Report. * 

A Decade of Computer-Assisted EJ174487 
Instruction . 



Palmer , Henry 



Three Evaluation Reports* of 

Computer Assisted Instruction 

in Drill-and-Practice Mathematics. 



ED087422 
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RoBWQt Richard A. 



Roniniy Franklin Delano 



Rubin, Martin L. and 
others 



S t . Aub in , Raymond 



Sasj^cer, Monica Flynn 



Sharman^ Heather and 
Dorward, George 

Suppes. Patxick and 



Morning; 



gstaiH: 



Mona 



Tira, Daniel Edward 



Wood, Dean A. 



Zachert, Martha Jane K. 
and Pantelidis, Veronica 



^ The Word Problem Program; Epll3212 
Sunmative Evaluation. ^ 

A SusBUtlve Evaluation of the ED1S3604 
CAI Course "Comps*" 

A Study of the Effectiveness ED072615 
of a Computer When Used as a 
Teaching and Le^rpixig Tool in 
High School Hathematics. 

Evaluation of the Experiaentai ED115225 
CAI Network (1973-1975) of the 
Lister Hill National Center for 
Biomedical Cotomunications , 
National Library of Mediqine, 
Final Report No. ED-75-1, 

Evaluation of C.A.I, as Used ED136775 
by Various Handicaps. 

1976-77 TICCIT Project. Final £3)148430 
Report. 

Evaluation of the Manitoba EJ119715 
Schools Computer Network. 

Computer-Assisted Instruction ED070246 
at Stanford, 1966-68: Data, 
Models, and Evaluation of the 
, Arithmetic Programs. 

An Introduction to the Theory ED052627 
and Application of the Product- 
Moment Family of Correlations 
via a Computer Assisted Instruct 
tional System. 

The Development and Diagnostic ED065303 
Ev3.1uation of the Monte Carlo 
Integration Computer as a 
Teabjing Aid. 

SIBE: A Sequential In-Basket ED056469 
•Exercise Technique. 
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Accession No; 



Focus Category 4; Conputer aana^ed iastrtiction ^ 



Chitayat, Linda 



Fletcher, J. D. and 
Atkinson, R. C. 



Goolsby, Thomas M. , Jr. and 
Stoltman, Joseph P. 



Hall, Keith A. and others 



Moench, Laurel ' 



An Evaluation of Co»puter- ED144524 
Managed Education Technology 
at Hew York City Conaaunity 
College. 

Evaluation of the Stanford EJ068074 

CAI Pfbgraa in Initial , 

Reading. 

Report on an IndividualiiEed ED069654 
Reading Skills and Social 
Science Program in Progress. 

The Development, Implesaenta- ED076053 
tion and Evaluation of a 
Pilot Program of Computer- 
Assisted Instruction for 
Urban High Schools: General 
Mathematics and Algebra I. 
Summary Report. 

The Effectiveness of an EJ)121874 

Individually-Organized 

Computer-Managed Program 

(PLAN) with Educationally Dis- " 

advantaged Students in Middle 

Elementary Grade Matheimatics . 

Program for Learning in A^ccord-- EJ092656 
ance with Needs: Developmental 
Phase. Evaluating Instructional 
Systems. 



Focus Category 5: Slide/ tape 



Barry, Roger D, and 
Carter, Robert A, 

Uthe, Elaine F. 



Evaluation of General Cheanistry 
Sllde/Audlo-Tape Programs. 

Assessing the Teaching Effec- 
tiveness 6f an Audio-Visual 
Program Relating to the Inten- 
sive Office Program in Business 
Education. 
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Focus Category 6; Audiotape 



Ellson, Douglas G. 
and others 



The Tech Prograiame:/ Self- 
Instructional Prograume for 
English Listening Comprehen- 
sion, Final Report. * 



ED084929 



Focus Category 7; Programmed instruction 



Cropper, George 



Kumro, Thomas and 
Camp, William L. 



Development of Course Content ED085349 

and Instructional Materials/ 

Aids for the Training of • 

Educational Research, Develop^- 

ment. Diffusion, and Evaluation 

Personnel. Supplementary Final 

Report. 

Applying Programmed Instruction. EJ049093 



Lena, Peter D. and 
Maser , Thomas F. } 



McGuigan; F. Jf. and 
others 



Moriber, George 



Singer, Frank A. 



Computer Assisted/Programmed ED058724 
Instruction on the Law. 
Final Report. 

A National Field-Test of Select- ED10959A 
ed Programmed Reading Materials 
for Undereducated Adults. 
Center Research Monograph No. 3. 

The Effects of Prdgrammed In- EJ013595 
struction in a College Physi- 
cal Science Course for Non- 
science Students. 

Self-Instructional Materials ED0S2291 
for Topics in Elementary 
Accounting — A Means to the 
Demonstration of Pay-Offs from 
Individualizing Time- to-Complete* 
Final Report. 
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Author (s) Title • V Accession No. 



Focus Category 8; Audio-tutorial 



Ross, Harvey L. 



Stevens, R. and others 



Taair, P. and Amir, R. 



An Evaluation of the Effec- 
tiveness of the Allen Teach- 
ing Machine at the F«ieral 
Correctional Institution, 
Loapoc, California. Final 
Report. 

AIMLdj Auto-Instructional 
Media for Library Orientation. 
Final Report. ^ 

Teaching Science to First and 
Second Grade Pupils in Israel 
by the Audio-Tutorial Method. 



ED043830 



ED105882 



EJ121403 



Focus Category 9; Satellites 



Bramble , William J. 
and others ^ 

Bramble, '^11 lam J. 
and others 



Caldwell, Kathryn S. 



Engler, Nick 

Kreimer, Osvaldo and 
others 



On the Beam: The Appalachian EJ139835 
Education Satellite Project. 

Performance of AESP Transmis- ED114063 
sion/Reception Equipment: 
Summer and Fall, 1974 Technical 
Report No.^ 5. 



EDH9719 



The Veterans Administration 
Experiments in Health Communi- 
cstions on the Applications 
Technology Satellite (AT-6) . 
Final Report. 



An A for AESP. EJ184O30 

Health Care and Satellite ED094721 
Radio Conimunicatlon in Village 
Alaska. Final Report of the 
ATS-1 Biomedical Satellite: 
Experiment Evaluation. 
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Accession "^^^ 



Bakjer, Eva L. 
Banks, Henry A, 



Fdcus >ga.tegorv 10; .i>rlnt ^(textg J. etc> ) 

Practicuai ibr Instructional 
' \ Deyelbpers. fuuil Report. ' 

Evaluatioii of an Instxuc- 
1^ , tioaal Prograa in Training < 
Teachers tol Analyze iduca- 
' tlonai Materials for jPossible 
, , ' Racial Biasi, 



• ^ ^Q98266 



ED090307 

t . ; ■ 



' >■ 



Harlen, Wynne 



A Cr^.tic^l Dook at tlie'Classi-; ' EJ131787 
cal Strategy Applied, to FQriaa- . ' ; 

tive Curriculum Evil^yation.* - ;. 



Instructional Materials in 
Manufacturing for JuhioS^High 
School IndustriaJ^ Art^. Final 
Report and Parts 'I-IV. 



EBd6573i 



O'Keefe, Ruth Ann 



Reports on the STARTER/ 101 
Pilot Project in the Re^in 
Center of the D. C. Publit 
Schools. / 



I 'eJ3045316 

4 . ' i 



Speedie, Stuart M, and 
Sanders « Susan 



Data Management & Decision s f ^^13^61^ ^ ^ 
Making. Technical Report I ' \ V 



Focus Category lit Simulation/games 



Altschuld, James W, and 
Pritz, Sandra 



Altschuld, James W. and 
others 



Planning Educat,ional Programs : 
An Evaluation Report for the 
Occupational Exploration - 
Program. » 

The Health and Welfare Module: 
An Evaluation Report for the 
Occupational Exploration 
Program. 



I. 

EDI 06503 ; \ 



ED106509 



Bartholomew, Robert and 
Meyer, Bonnie 



Developing and Evaluating Learn- ED132779 

ing Devices for Exceptional 

Children. 
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Clju;:k<t, Hentuortb 



pollett, Leverne S. 
and 'Others 




Cratfty, Bip^ant 
Szcze;panlk, Sister i^rk 



Gohring, Ralph an4 
Chikrelott, Leigh 



A Research Not« iOft Sil^tlatloo J;j03577.4 
in tiSe Sociai Stui^ie^i " 

Foraative atid Suauawtive Evalu- ' 'ED13i055 
ation of the FEHR-Practicum 
Training Hodu^.*. , Final Repart. 

Th6 Effects of" a Program of ED057U9 
Leamin;g Gamfes upon Selected ' 
Acadenic Abilities in <SlniMr 
with lieaming Difficulties, 
1970-1971. 



"Hubert, Btldd^ 



Kinder, Steven J. and 
Guthrie, John T. 

Laosa, Luis M, .and 
others 



Scheieir, Elaine and 
Senter, Donal^ R. 



$tocker, H. Robert 
and o thers . ' 



. ThfeiOse of a Sisaulation Gaiae 
t!b Assess and Influence tih^ - 
Le«<iership Styled of 'Elejs^tary 
Frincipals: The Principal Game. 

^ The New Town 'Game: Ev^u- 
^tion Jased on Instructionalj- 
Experienci^^ , 

The Training Effects of a, Be- 
havior Modification Gfuae. ; 

An Evaluation of Non-Formal 
Education iii Ecuador. Volume 
^: Finding's. final Report. 

' ' : ' i 

\ Evaluation of teaming 1^0: ■ 
An' Adult Basic Education Pro- 
ject in Bedford-Stuyvesant, 
19^7-68. 



ED137362 



EJ06904A 

ED057613 
ED116S81 

■ED0A4551 



MOE: A i'rogress Report on EJ028863 
Mobile Simula|:ion. 



Focus Category 12; Use computers for admlnlstratipn/evaluatlon 



Lewis, R^ichard^ F. 



A Survey of 1972 Tegcher Opiri- ED092101 
ion. .Observational Report No. 

7217. . 

( 

• ( 

Media Implementation through ED0495^8 
Teamed Supervision. Evalu- 
ation'; Title Three, ESEA. 
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Pinsky, Paul D. 



Htle 



Accession No* 



Achievea^nt Monitoring of * ED092175 
Individually Paced Instruc- - 
.tion. Final Report.. 

Research and Evaliaatlon of 'ED073589 
Computer-Based Resource Units . 



Focus Category 13: Hulti-inedia programs (other than slide/tape) 



^ Barry, Roger D. and 
Carter, Robert A. 



Evaluation of General Chem- 
istry Slide/ Audid-Tape Pro- 
grams • 



ED066124 



Branson, Robert K. , 



Bravo, Anne 



Brickner, Ann and 
Senter, Donald R. 



Brickner\ Ann and others 



Formative Evaluation Procedures 
Us^d in Designing a Multi-Media 
Physics Course. 



An Evaluation of. the Urban Educa- 
tion Program **Multi-Sensory StJ^^ 
tions Program," District 10, 
New York City Board o* JEdtfcation. 

Follow-Uji Study of LISTEN LOOK 
LEARN First tear Students Who 
Used Traditional Basal Programs 
in Second Year. 

• v. ' \ 

Sunanative Evaluation of LISTEN 
L08k learn 2n<$, Year Students, 
Cycles ,R-70, 1968-69. 



ED050140 



ED059024 



ED 049018 



ED 049016 



Buffer, James J. and 
others 



DeVitt, Joseph ^ 



EllsQn^ Douglas G, 
and others 



A Junior High School Industrial ED054389 
Technology Curriculum Project: 
A Final Evaluation of the Indus- 
trial Arts Curriculum Project' 
(lACP)^ 1965-1971. 

>. 

Do^ Federally Funded Prpgrams EJ078922 
Really Work? The State View. 

The Tech Programme: A Self- Ep084929 
Instructional Programme for 
English Listening Comprehension. 
Final Report . ' < 

An Evaluation of Educational ED070291 
Media Programs In Kansas Unified 
School Districts.. 
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Accession No. 



Heflin, Virginia A. 
and others 



The Fpn^tive Period of LISTEN ED049019 
LOOK LEARN, a >feilti-41edia Co«- 
minicatioa Skills Syst^. 

Helping Leaders Help Youth, An ED141000 
Evaluation Report of a Program 
for Illinois Volunteer 4-H V 
Leaders, 1973--75. . ' 



Johnson 9 Bruce A. and 
Pierce, John 



Kline, James A. 



Peterson, Betty L. 



Scheler, Elaine and 
*Senter, Donald R. 



Vinci, Thomas G. and 
DeVita, Christina 



J 



Research Brings Proof of Value,. ' EJ105447 
Future Direction to Sales ' 
Tnj^niiig. /* 

Evaluation of a Multimedia Drug EJ066205 
Education Program. ^ 

A Comparison between Achieve- ED129282 

ment Gains in Multimedia Inr 

struction and Copventional 

Lecture >fetlK>d of instruction 

of Nursing Courses at Northern 

Virginia Comaunity College. , - 

Phase I Report. Economic ED073657 
Analysis Course. ^ 

Evaluation of Learning 100; ED036718 
ABC Center, White Plains, N.Y. 
Janiiary-June 1968. 

An Evaluation of the State ED059881 
Urban Education Program 

"Living Science Center" -Dis- .* 
trict 10^ New York City ' 
Board of Education. 

Visual Concepts Program: An ED129872 
Evaluation Report. 

Vocational Campus Multimedia ED079476 
Learning Laboratory Program- 
Extension. 



'Focus Category 14: Film 



Kelly, Donald and 
Byrne, Thomas P. 



The Evaluation of Filmed 
Excerpts of Rogers, Perls, 
and Ellis by Beginning 
Coi^nselor Trainees. 



EJ156778 
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Accession Ko 



Hoodie, Allan G. 



Sohn, David A. and 
Stucker, Helinda 



An Evaluation of the "Drugs 
Are Like That" Progran, 

Film Study in the Elementary 
School: Grades Kindergarten 
through Eight . A Curriculum 
Report to the American Film 
Institute. 



ED077951 



ED032316 



Foeug Category 15 r Microfiche 



Kellex^, F. Laurence and 
Rizzo, WHliapi A. 



An Evaluation of Microfiche 
Reader Types for Use with 
Programmed Instruction . Phase 
I, March 197'6"August 15^76, . k/ 



ED128006 



Focus Category 16: Individualized instruction programs 



Anderson, Beverly L.^ 



I' 

Kodi^ Island Borough School 
District Title IV Project- 
Final Evaluation Report, July- 
1977. *• 



ED1423S9 



Appel, Marilyn and others 



Bailek, Hlltou M. and, 
Castro, Barbara 



Cognitive, and Affective Out- 
comes In CkU|dren aa a Func- 
N tion o£ Participation in SOIL, 
an Individualized Version of 
the SCIS Program. 

A Second Year Evaluation of 
Individualized Prescribed 
Instruction (IPI) . 



ED0973'79 



ED036157 



Bennie, Frances 



Brown, Edward K. 



Pupil 'At.titudes toward Individu- EJ085878 
ally Prescribed Lab Programs. 

The Nongraded Program at the ED049298 
Powell Elementary School: 
Evaluative Phase II. 



Evaluation of and Information 
Concerning Individually Pre- 
scribed Instruction in. Mathe- 
matics (IPI): 1967-1968, 
Friends School, Wilmington, 
Delaware. 



ED036161 
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Accession No. 



An Experimental Approach to - 
Developing liodel Prograas for 
Early Childhood Education. 
Final Report. 



ED088559 



Fehrle, Carl C, 



Individualized Prescribed ED041462 
Instruction: . A Critique. 

Individually Guided Education; EJ092657 
Dei»criptioh of IG£. Evaluating 
Instructional Systems. 

Individually Guided Education ED154493 
(IGE) Program. 1974-1975 . 
Final Report. 

Individually Prescribed Instruc- EJ09265B 
tion: Developoental Phase. 
Evaluating Instructional Systems,. 



Ironside, Roderick A. 



p>yJohnson , Lary 



Johnson, Lary 



The 1971-72 'Nationwide Installa- 
tion of the Multiunit/IGE Model 
for Elementary Schools. A 
Process Evaluation. 

The fourth Y^ar of IPI Mathe- 
matics at Minneapolis Hall 
School: 1972-73. A Title I 
>ESEA Project. 

Minneapolis IPI >fethemat4.cs - 
Project 1971-72: Third Year 
.Evaluation. A Title I, ESEA 
Project. * 



ED066623 



ED114430 ^ 



ED08329O 



Johnson, Lary and 
Ostrum, Donald R. 



Second Year Evaluation, IPI 
Mathematics Project: Hall 
School, 1970-71. 
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Katzenmeyer , Conrad G, 
and other^ 



Kaufman, Maurite 



Kaufman. Maurice 



Evaluating IGE: An Initial' 
Literature Review and Explora- 
tory Study. Technical Report 
No. 404. , 

The Effect of the DISTAR In- ' 
structional System; All Evalu- 
ation of the 1972-1973 Title T 
Program of Winthrop, Massa- 
chusetts . 

The Effect of the DISTAR 
stTuctional System: An Evalu- 
ation of the 1973-1974 Title I 
Program of Winthrop, Massa- 
chusetts. 
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ED110170 



Author (s) 



Title 



Accession No. 



Klausmeier, Herbert J. 
and others- 



A Report on the Utilization 
of Individually Guided Moti- 
vation. Technical Report. 
No. 388. 



ED134559 



Kula, George 



The Effects of the TWo Summa- 
tive Evaluation Methods on 
Achievement and Attitudes in 
Individualized Seventh-Grade 
>fatheiaatic5. 



ED090279 



Lambrecht, Judith J. 
and others 



Leinhardt, Gaea 



An Evaluation through Field 
Testing of Individualized 
Instruction Materials in • 
Wisconsin^ Post-Secondary 
Institutes, Final Report and 
Appe^^dices . 

Program Evaluation: An Empir- 
ical Study of Individualized 
Instruction. 



ED069851 



ED1310%2 



Mack, Herschel and 
Littlejohn, Stephen 



PS I as an Apptoach to^ the 
Telling of Empirical Re- 
sea«£h Methods. 



ED149408 



Miller, Leonard Ai 
and others 



Studies in Continuing Educa- ' 
tion for Rehabilitation Coun- 
^ seldrs. Report No,^ 3, 
October 1971. 



ED134850 



Morgan, Virginia 
Richardson 



A Cost Study Analysis df 
Measured Cains in a Reading '< 
Program Utilizing Individuali- 
zation of InstruQtion. 



ED1Q3534 



Pad en, Jon^,'5> 



How Is ICE Doing in the Elemen-- 
tary Schools? A Four-Year ^ 
Survey of IGE Principals, 



ED144221 



Pre-Kinderga^rten Prescriptive 
Teachings Program for Disadvan- 
taged Childrer^^ Pte-School'* 
Program 1972-73: End of the 
Year Evaluation. 



ED091061 



Ryckraan, David B, 
and others 



Do Structuigpd Reading Programs 
Hamper Tnt(»llec tual Development? 



EJ148674 
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Accession No, 



Sovik, Nils 

Stefanides, Gilbert Albert 
Stlce, James fe* % • . 



St Ice y James E. 



Tatha»>/Elalne L. and 
others a 



Vaughn, ^ohn W. and 
Duncan, Robert C. 



Welnstein , Sanf ord^ 



Weiss, James 

Williams, Wil^^am Watts 



Individual Instruction in EJ177005 
Norwegian (The Podin Project) • 

An Evaluation of Achievement ED127613 
and;Attitudes of Students and ' 
Teachers Using an Individual- 
ized Spelling Approach^^ 

Expansion of Keller Plan In- Epl22723 
struction in Engineering and 
Selected Other Disciplines: 
A Pinal Report r 



Seventeen PSI Projects at the 
University of Texas at Austin. 



108665 



Evaluation of College Learning ED110141 
Center Instruction in Six Sub- 
ject Areas, Spring 1975. 

Evaluation of Merrimack Educa- ED11436i7 

tlon Center ^s Project League 

1973. u ^ ^ . ^ 

Diagnostic and Remediation Pro- ED136487 
^ram to Ameliorate the Reading 
Disabilities of JHS CRMD Pupils, 
February- June, 1975. Evaluation 
Report. 

More Advanced Reading Develop-^^ ED142'631 
ment, 1975-76 School Year. / 

An Experimental Investigation ED052015 
of Individualized Instruction 
in the ^Teaching of Quantitative 
Physiqal Science. 
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METHODS OF EVALUATION 

* • . " 

Many Msearchers and practitioners are interested in the use of a 

particular method for gathering evaluation data. In an attempt to serve 

the needs ot these individuals, the researcher analyzed the abstracts fot 

each citation identified as an evaluation study, for purposes o^ classi- 

•^fyirig the studies according to method(s) usefd. / 

^ The researcher again developed categories of methods J)y a review of 

abstra^^ts^ This time, 20 categories were identified, each representing . 

a different method of gathering evaluation data. This time, however, the 

. r ■ 

sorting process proceeded sopj^Kat differently, due to the fact that many 

of the studies cited multiple methods used in the study. Thus, for each 

^ method cited witliin a* given study, the researcher noted the number of that 

Study in the appropr.iate methods categary. Some studies were mentioned in 

as many 'as a half-dozen methods categories. ^ 

Classifying stories by method turned out to be the mos^ difficult 

task, for several reasons. Many study abstr-acts included results of the 

evaluation, bu'^ failed to include a description of methods usted. An 

examination of the full evaluation report would undoubtedly yield an 

inventory of methods used; because the Researcher used only abstracts, 

some studies Will not appear in the categories. In addition, some 

abstracts mentioned methods; but often in an ambiguous way. In some of 

those cases, the researcher could infer from the context of the abstract 

s 

^ what method had been used. Mistakes in categorization were thus inevitably 

made. Witl^iln the framework of these cautions, however, the user of this 
document may find some Ijelpful guidance through the ERIC evaluation studies. 

A brief description of eac]^ methods category, together with a tally of 
how many times the method was reported used, follows, 
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^.Category 1: Standard tzed tests (34 citations) 

Refers to the use of a "test designed to provide a systessftatic 
saxiple of individual performance, administered according to 
prescribed directions, scortid in conformance with definite " 
rules, and interpreted^ in reference to certain normative inforr 
mation* Some would further restrict the usage of the term 
'standardized*- to thase teats for iriiich the Itesis have been 
chosen on the basis of experimental evaluation, and for which 
data on reliability and validity are provided. Others would 
add *coi»nercially published* and/or 'for general use.*"'^ 
* - . ' 

Category 2: Teacher -made tes j;<r ' 1 ' (61 citations) 

Refers to tests of knowledge or skills developed by a teacher, 
administrator, or developer of a program or materials, unique 
to a particular setting, objective, or instructional program. 
Such tests are seldom normed on large samples, if at all. Sjich 
V tesi^ need not he pencil-artd-paper tests. 




Category 3: Questionnaire/ i^urve y (78 citations) 



Refers to instruments desired to gather perceptions, , opinions, 
Judgments, etc • from a group of people about a particular topic 
or issue. Included here are attitude surveys, questionnaires 
for teachers, parent^, community members, students, etc. 

Category 4: Rating forms (11 citations) 

4? ■ • , 

"kefers to instruments which require the respondent to rate, 
according to some scale or procedure, the materials, program, 
etc. being evaluated. 

Category 5: Interviews (22 citations) 

t , ' 

Refers to oral questioning, either structured or unstructured, 
usually in an attempt to gather in depth descriptions or opinions 
from the respcjiderit. May be face-to-face or by telephone, exchange 
of audio/video' tapes, etc. / 

■ ■ ■ ■ {' ' ■ ' 

Category 6: Observat lori > (18, citations) 

Generally refers to observation of participants engaged in a 
learning activity. This observation may be done obtrusively 
or unobtrusively, and may use a structured observation schedule 
or unstructured approach. - ^ 

* 

Category 7: Expert review (13 citations) 

/ 

Refers to assessments of a material or program by someone regarded 
as an expert in some facet of the thing being evaluated, or in 



■^From Mehrens, "VKlliam and Lehmann, Irvln, Measurement In Educatloii and 
Psychology . New Yorlf: Holt, Rlnehart and Winston, Inc., 1973, p. 696. 
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he evaluation process. Included are site visits, teacher^^ 
.n^dotal assessment of learners , 



Category 8: Document review (14 citatiojis) 

Refers to exaijiiination cyf^exis ting documents (e.g., curriculum 
guides, histories, etc.) for data relevant to a program being 
evaluated.^ Document review is generally an unobtirusive data 
gathering method. 

Category 9: Content analysis - (6 citations) 

Refers to systematic- analysis of various forms of communication 
(e.g., curriculum materials, memos, speeches/lectures, etc.) to 
provide data relevant to the program being evaluated. 

Category 10: Cost ana ^y^^s (13 citations) 

Refers to "a variety of methods used to determine the cost (however 

defined) of developing and/or implementing programs, materials, 

or systems. Often used in an effort to relate costs to benefits. > 

Category' 11: Case study (4 citations) 

■t 

An in depth study of a Riven program in an effort to thoroughly 
/ understand that program. Tends to include a variety of dlethods 
of data gathe,ring and analyses, 

^Category 12: Record tracking * ^ (5 citations) 

Refers to analyses of records of Interaction, usually between 
computer and learner in some CAI systems, .,as stored in 'the 
computer. v 

Category 13: Response sy^s terns (1 citation) 

Refers to the ^se of automated response systems, wherein the 
respondent can indicate preferences or choices ,„ usually through 
a button system. 

Category 14: .. Simulation (1 citation) 

Evaluator observes or examines respondents^ actions or choices 
during* simulation e^xercises. 

Category 15: Phys lological responses (2 citations) 

Refers efforts to gather evaluation data by observing ^r 
measuring physiological respOTises to a stimulus, such as a 
^ television program. Includes eye movement analyses, GSR, etc. 

Category 16: Ranking procedure s (1 citation) 

Respondents are asked^to rank order the importance, value ^ or 
desirability of a grottp of Items, 
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Category 17: Consensus tnetliods . - (1 citation) 

Refers to atteiitpts to obtain consensus from a group about a 
need, future event, etc., based on an iterative survey <e.g., 
Delphi technique) . 

Category 13: Distracter technique (1 citation) 

I 

Attempts are made to record the influence of a distracting 
element on the behavior of individuals watching a television 
program. 

Category 19: Audience rating systems (1 citation) 

Refers to audience survey techniques such as the Neilseri rating 
scheme. 

i ' . ■ ■, 

Category 20: Essays/personal statements (1 citation) 

I 

< • 

Respondents are asked fco write essays or personal statements on 
a topic specified by the evaluator. Results are analyzed for 
evidence of ^ange or growth. 



^ The classification by evaluatloa method produced few surprises. 
Questionnaires/surveys were the single most popular methods used in the 

♦evaluation studies included in this analysis. The (relative) ease with 
which they are constructed and used makes them invaluable methods fot 
data-gathering. Teacher-made tests (broadly defined) and, to a somewhat' 
lesser extent, standardized tests are the cornerstones of attempts to 
describe outcomes and effectiveness. Interviews and observations are also 
popular methods for evaluating instructional technology..- 

What is somewhat, surprising, however, is' that evaluators of instruc- 
tional technology programs and materials do not appear to be pioneering 

"many new data-gathering methods. It is interesting, for example, that so 
few studies report using simulations or distractor techniques. The con- 
clusion must be tentative; those studies f or ^ich abstrac"ts did not 
describe methods may have used such techniques. 
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Following ar6 the author(s), iltle, and accession nuo^er of those 
citations identified in^each methods category. 



Author (s) 



Title 




ion No. 



Methods Category 1; Standardized tests 



Anderson, Beverly L. 

/ 

' Ball, Samuel and 
Bogatz, Gerry Ann 

Ball, Samuel and \ 
others 

B^^ci^l)^^^ Fleming 




Briclcbfer, Ann and 
Senter, Donald R. 



Brie kner, Ann and others 



Brlghtman, Richard W. 



Brovn , Edward K, 



Kodiak Island Borough School ED142359" 
District Title XV Project. 
Final Evaluation Report, 
July 1977. 

Research on Sesame Street: 
Some Implications for Compen- 
satory Education. 

Reading with Television: A 
Follow-Up Evaluation of the 
Electric Company. ^ 

The Construction, the Imple- 
mentation, and the Evalu-- 
ation of a Title I Primary ^ ' 
Grade Listening Program. 

Follow-Up Study of LISTEN LOOK Sed049018 
LEARN First Year Students Who 
Used Traditional Basail Programs 
in Second Year. 

Summative Evali^ation of LISTEN ED049016 
LOOK LEARH 2nd Year Stu(3ents, . 
Cycles R-70, 1968-69. 



ED068155 



ED122798 , 

■7' 



ED127626 



Computer Assisted Instruction ED0678 
Program for Police Training. 



The Nongraded Program at the • ED049298 

Powell Elementary School: 
Evaluative Phase II. • «■ 

I 

Detennining the Effects of ED093484 
"Developinp, Readiness for Pre- 
school Children via Television": 
A Title III Project. 



ERIC 
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Author (s) 



Title 



Accession No. 



Ford, John D., Jr. and 
Slough, Dewey A. . 



Hall, Keith A. and 
others . ^ 



Heflin, Virginia A. 
and others 



^ Johnson, Lary 



Johnson , Lary 



Kaufman, Maurice 



Leinhardt, ^aea 



Development and Evaluation of ED042950 
Cosputer Assisted Instruction 
for Navy Electronics Training. 
1. Alternating Current Funda- 
mentals . . 

The Development, Inpleaentation' ED076053 
and Evaludtion of a Pilot Pro- 
gram of Coraputer-Aasisted In- 
struction for, Urban High Schools: 
General Mathematics and Algebra 
I. Suianary Report. 



The Formative Period of LISTEN 
LOOK LEASN, A Hulti-Media Com- 
immication Skills System. 

Individually Guided Education 
(IGE) Program. 1974^1975 \ 
Final Report. 

The Fourth Year of IP 1 Mathe- 
matics at Minneapolis Hall 
School: 1972-73. A Title I 
ESEA Project. 



Minneapolis IPI Mathematics ED083290 
Project 1971-72: Third Year 
Eyaluatipn. A Title I, ESEA 
Project. 



ED049019 



ED154493 



,EDU4430 



^imoi7i'^ 



The Effect of the DISTAR In- 
structional System: An^ Evalu- 
ation of the 1972-1973 Title I 
Program' of Winthrop, Massa- 
chusetts, 



Program Evaluation: An Empir- ED131092 
leal Study of Individualized 
Instruction. 



Lysiak, Fae and others 



Moench, Laurel 



Computer Assisted Instruction. ED140495 
1975-75 Evaluation Report. A 
Title I Program. Revised. 

The Effectiveness of an Indi- ED121^74 
vidually-Organlzed Computer- 
Managed Program (PLAN) with 
Educationally Disadvantaged 
Students in Middle Elementary 
Grade Mathematics. 
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Author(8) 



Title 



Accesslcm No< 



O'Keefe, Ruth Ann 



Repc^i'ts on the STARfER/101 
Pilot Program in the 'Reading 
Center of the D,C. Public 
Schools . 



ED045316 



Palmer, Henry 



Three Evaluation Reports of 
Computer Assisted Instruction 
in\^Drillr.and-Practlce Mathe- 
matics. 



ED087422 



Peterson^ Betty L. 



Pinsky, Paul^D, 



A Co^arison between Achieve-^ ED129282 
mept Gains in Multimedia In- 
structVon knd , Conventional 
Lecturey Method of Instruction 
of Nursing Courses at Northern 
VirginiaVCommunity College. 

Achievemerit Mc^hitoring of ED092175 
Individually Paced Instruc-- 
tion. Final R^ort* 



Roman, Richard A. 



Scheier, Elaine and 
Senter, I^ald 



Scheier, Elaine and 
Senter, Donald R. 



Shapiro, ^Sydelle Stone 
and others 



S livers t: ein , Leonard 



Pre-Kindergartei^ Prescriptive 
Teaching Progtani for Disadvan- 
taged Children. ' Pre-SchooL 
Program 1972-73: End of the 
Year Evaluation. 



ED091061 



The W^rd Problem Program, 
mative Evaluation. 



Sura-r 



Evaluation of Learning 100: 
Adult; Bas^c Education Project 
in Bedford-Stuyvesant, 1967-68. 

Evaluation of Learning 100: 
ABC Center, White Plains^ N.Y. 
January- June 1968, 

An Evaluation of the Mulligan ^ 
Stew 4-H Jelevision Series for 
Extension Service, USDA. Vol- 
ume I: Executive Summary. 

Project Turnabout, School, Year 
1975-1976. 



ED113212 



ED044551 



ED036718 



ED134618 



ED142640 



Topical Modules In Secondary 
Mathematics . Final Project 
Report. 



ED107478 
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Weinsteln , Sanf ord 



Weiss, Jame^ 



WiUlams, William Watts 



Vocabulary Developnient Pjpj- 
ect.^ Evaluation Report 2 • 

Diagnostic and Remediation 
Program jp Ameliorate the 
Reading Disabilities of JHS 
CRMD Pupils, February- June ^ 
1975, Evaluation Report. 

More Advanced Reading Develop- 
laent, 1975-76 School Year. 

An Experimental Investigation 
of Individualized Instruction 
in the Teaching of Quantitative 
Physical Science, 



Methods Category 2; Teacher-^made tests 



Adler,^Leta McKinney 
^nd others 



Altschuld, James W* 



Ballek, Hilton M. and 
Castro, Barbra 



Ball, Samuel and 
Bogatz, Gerry Ann 



Ball, Samuel and others 



Ball, Samuel and others 



Evaluation of Programmed In- 
struction Techniques in Medi- 
cal Interviewing; Final 
Report, June 15, 1966 tro 
June 15, 196*8. 

The Health and Welfar^ Modtile: 
An Evaluation Repot;t tor the 
Occupational Exploration 
Program,-- 

A S^econd Year Evaluation of 
Individualized Prescribed ' 
Instruction (IPI) . 

Sesame Street Summative Research 
Some Implications for Education 
and Child Development. 

The First Year of Sesame Street: 
^n Evaluation. Final Report, 
Volume III of V Volumes. 

Reading with Television: An 
Evaluation of the Electric 
Company. A Report to the 
Children's Television Work^ 
shop. Volumes 1 and 2. 
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Author(s) 



Title 



Accession No. 



T 



Blackburn, Slisan Fleming 



Bravo , Anne 



Brightman., Richard W. 

1 

Broynf Edward K. 
Caldwell, Robert M. 



Clausing, Gerhard and 
others 



Cratty, Bryant J, and 
Szczepanik, Sister Mark 



Cusano, Bernard, 



Deihl, Ned C, and 
Zelgler^ Ray H. 



The Consl;ruction, the Ixsple- ED127626 
n^ntatlon, and the Evaluation 
of a Title I Primary Grade 
Listening Program. 

*i ' ' ■ 

An Evaluation of the Urban ED059024 
Education Prograxfi "Multi- 
Sensory Stations Program/' 
District 10, New York City 
Board of Edi^cation. • 

Computer Ajra^sted Instruction ED067858 
Program fCr rb^ice Training. 

The Nongraded Program at the ED049298 
Powell Elementary School; 
Evaluative Phase II. 

Literacy ifevelopment Using a ED089216 
programmed Text and Computer 
Assisted Ir^struction, 

Individualized German Ins true- EJ088050 
tion at the College Level: A 
Follow^u|i Report. 

Computer Aided Learning Project: ED129281 
Report, Trial 3/ 

The Effects of a Program of EQ057119 

Learning Games upon Selected 

Academic Abilities in Children 

with Learning Difficulties, 

1970-1971, ' " ^ 

Children *Leafn to Read through ED142626 
Cooperative Teaching of Para- 
prof es^ionals and Teachers : 

Evaluation of Computer-Assisted ED067897 
Instruction in Instrumental 
.Musicianship. Final Report. 

An Evaluation of the Instruc- ED128579 
tlonal Television Program Basic 
Education: Teaching the Adult. 

An Experimental Approach Lo • ED088559 

Developing Model Programs for 
Early Childhood Education. 
Final Report. 
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Author (a) 



Title 



Accession No. 



Fisher, Kathleen M. 
and others 



Ford, John D. , Jr, and 
Slough, Dewey A, 



Grants William D. and 
Clark, Norma 



Hall, Keith A. £^nd 
others 



Harlen, Wynne 



Johnson, Lary 



Johnson, Lary and 
Ostrum, Donald R. 



Kastner, Si^ieldon 
Kaufman, Maurice 



Kidder, Steven J. and 
Guthrie, John T, 

Klein, Stephen P. and 
others 



The Effectiveness of Video- ED143694 
Autotutorial Instruction for 
a Very Large Enrollment 
University Course in Science. 

Development and Evaluation of ED042956 < 

Computier Assisted Instruction 
for Navy Electronics Training. 
1^ Alternating Current Funda- 
ijientals . 

A National Survey of Current ED100073 
aicid' Anticipated Media Equip- 
tiient in Residential and Day ■ ^ 

Programs for the Hearing 
Impaired/ / 

tl)e' Dl^velopBierit , lTnplefflent;ation ED076053 
rSnid, Eyaluation of a Pilot P^^^ i», 

gr«tnj Qf Cdmputer-Assisted 

Ihstructioti f or Urbaji High 
" Schqpl^: : Gieneral Mathaaatics 

and Algebra I. Summary Report. 

A Critical Look at the .Classical Ejl31797 
Strategy Applied tp Formative * 
Curriculum Evaluation^ 

T 

Minneapolis IPI Mathematics Proj- ED083290 
ect 1971-72: Third Year Evalu- 
atioh. A Title I, ESEA Project. 

Second Year Evaluation, IPI EDQ67874 
Mathematics Project: Hall 
School. : • 

Skia, Scale, Feather, and Fur. ED1A1486 

The Effect of the DISTAR In- ED110170 
structional System- An Evalu- 
ation of the lS0-l97h Title I 
' Program of Winthrop, Massa- 
chusetts. 

The Training Effects of a ED057613 
Behavior Modification Game. 

A Progress Evaluation of Four ED109260 
Bilingual Children's Tele- 
, vision Shows . 
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Author (s) 



Title 



Accession No. 



Kulm, George 



The Effects af the Two Sunana- 
tive Evaluation Methods on 
Achiev^ent and Attitudes in 
Individualized Seventh-Grade 
MathexnaticB. 



ED090279 



Laosa, Luis M« 



CarrascoXendas : 
Evaluation. 



A Formative 



ED090968 



Laosa, Luis M. and 
others 



Longo, Alexander A. 



Ldngo, Alexander A. and 
Gl|\inti, Frank E. 



McGuigan, F. J. and 
others 



Mack, Herschel and 
Littlejohn, Steph^r^ 



An Evaluation of Non-Formal 
Education in Ecuador. Volume 
3: Findings. Final Report. 

A Suramative Evaluation of Com- 
puter Assisted Instruction in 
U, S. Army Basic Electronics 
Training. Technical Report. 

A Sequential Evaluation of Com- 
puter Assis.ted Instruction in 
U. S. Army Basic Electronics 
Training. 

' ^ ' 

A National Field-Test of Select- 
ed Programmed Reading Materials 
for Undereducated Adults. Center 
Research Monograph No. 3. 



PSI as an Approach to the Teach- 
ing of Empirical Research 
Methods • 



EDI 16881 



ED074699 



ED082472 



ED109594 



ED149408 



McKeovm, James C. 



Mays", Luberta and 
ctthers 



PLATO Instruction for Elemen- ED123467 
tary Accounting . 

An Evaluation Report on Vege- ED120204 
table Soup: The Effects of a 
Multi-Ethnic Children's Tele- 
vision Series an Intergroup 
Attitudes of Children. Precis 
arid Oversew. 

Media ImpJ^tnimnCation through ED049398 
Teamed' Supervision. Evaluation: 
Title Three, ESEA. • 

Missouri Environmental Studies ED09389'5 
Approach (MESA) Interim Evalu- 
ation Report. July 1, 1972- , 
June 30. 1973. 
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Morgan, Virginia Richardson 



A Cost Study Analysis of Meas- 
ured Gains in a Reading Program 
Utilizing Individualization of 
Instruction, 



ED103534 



Moriber, George 



The Effects of Programmed In-- 
struction in a College Physical 
Science Course for Conscience 
Students', 



EJ013595 



Nolan, Jeanne and 
Gross, John 



Mulligan Stew: An Evaluation of 
the Television Series* 



ED105889 



Olien, C- N. and others 



A Systems Evaluation of a Pur- 
posive Message; The "Mulligan 
Stew" ETV Project. 



ED122794 



One Nation, Indivisible? A ED045460 
Summary of Evaluation Findings, 

Pre-Kindergarten Prescriptive ED091(Jpl 
Teaching Progj^p for Disadvan- 
taged Children. Pre-School 
Program 1972-73: End of the 
Year Evaluation. 



Radllck, Michael S. 
O'Reilly, Robert P. 



and 



Learning from Television: 
Television Based Learning 
System as a Capable School 
Resource. 



ED129254 



Roinaniuk, E. W. 



A Suinmatlve Evaluation of the 
CAI Course "Comps." 



ED153604 



Ronan, Franklin Delano 



A Study of the Effectiveness 
of a Computer When Used as a 
Teaching and Learning Tool in 
High School Mathematics. 



ED072615 



Sasscer, Monica Flynn 



1976-77 TICCIT Project, 
Report - 



Final 



ED148430 



Scheier, Elaine and 
Senter, Donald R. 



Evaluation of Learning 100: 
An Adult Basic Education Proj- 
ect in Bedford-Stuyvesant , 
1967-68. 



ED044551 



Shapiro, Bernadette Nelson 



Comprehension of Television 
Prograxrani ng Designed to Encour- 
age Socially Valued Behavior in 
Cliildren: Formative Research 
on "Sesame Street" Prograinialng 
with Social and Affective Goals. 



EDi22863 



Author U) 



Title 



Accession No. 



Silvers tein, Leonard 



SiJnger, Frank A. 



Stefanides, Gilbert Albert 



"'Tamir, P. and Amir, R. 



Tathain^ Elaine L. and 
others 



Thomps^on, John F. and 
others 



Uthe, Elaine F. 



Project Turnabout, School 
Year 1975-^.976, 

Self-Instructional Materials 
for Topics in Elementary 
Accounting — A Means to the 
Demonstration of Pay-Offs 
from Individualizing Time-to 
Complete. Final Report. 

An Evaluation of Achievement 
and Attitudes of Students and 
Teachers Using an Individual- 
ized Spelling ^Approach. 

Teaching Science to First and 
Second Grade Pupils in Israel 
by the Audio-Tutorial Method. 

Evaluation of College Learning 
Center Instruction in Six Sub- 
ject Areas, Spring 1975. 

Evaluation of Educational Tele- 
vision in University Extension 
Youth Programming. 

Assessing the Teaching Effec- 
tiveness of an Audio-Visual 
Program Relating to the Inten- 
sive Office Program in Business 
Education. 



ED1A26A0 



ED082291 



ED127613 



EJ121403 
ED110141 



£D044639 



ED155191 




VanWar t , Gerald ine 



Carrascolendas: Evaluation of 
a Spanish/English Educational 
Television Series within Region 



XIII, Final Report. 
Component . 



Evaluation 



ED092089 



Williams, Frederick 
and others 



Carrascolendas; National Evalu- 
ation of a Spanish/English 
Educational Television Series, 
' Final Report , 



ED078679 
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Author (s) 



Title 



Accession No. 



Methods Category 3; Questionnaire/survey 



Adler, Leta McKiimey 
and others 



Altschuldy James W« 
and others 



Anastasio, Ernest J. 



Appel, Marilyii and 
others 



Evaluation of Prograxmned ED059345 
Instruction Techniques in 
Medical Interviewing. Final 
. Report, June 15, 1966 to » 
June 15, 1968. 

The Health and Welfare Module: ED1065G9 
An Evaluation Report for the 
Occupational Exploration Pro- 
. gram. 

Survey of Instructor Activi- ED072071 
ties and Attitydes. 

Cognitive and Affective Out- ED097379 
comes in Children as a Func- 
tion of Participation in SCIL, 
an Individualized Version of 
the SCIS Program. 



Ball, Samuel. and 
Bogatz, Gerry Ann 



*Ball, Samuel and 
others 



Research on Sesame Street: 



Some Implications fo 
satory Education. 



r Xc 



ompen^ 



The First Year of Sesame 
Street: An Evalua^tion. 
Final Report, Volume III of 
V Volumes. 



ED068155 



1 

ED047823 



Ball, Samuel and 
others 



Bennie, Frances 



Bravo, Anne 



Reading with Television: An 
EV^aluation of the Electric 
Company. A Report to the 
Children's Televisi^ Work- 
shop. Volumes 1 and 2. 

Pupil AtJ^tudes toward Indi- 
vidually Prescribed Lab Pro- 
grams . 

An Evaluation of the Urban 
Education Program '^Multi- 
Sensory Stations Program. 
District 10, New York City 
Board of Education. 



ED073178 



EJ 085878 



.ED059024 
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Author (s) 



Title 



Accession No. 



Brickner, Ann and others 



Caldwell, Robert M. 



Carpenter, C. R. aiWi 
others 



' Summati^e Evaluation of LISTEN ED049016 
LOOK LEARN 2nd Year Studeats, ' 
Cycles R-70, 4968-69. 

Literacy Development Using a ED089216 
Programmed Text and Computer 
Assisted Instruction. | 

Educational and Instructional ED037101 
Television Facilities Evalu- 
ation: Preliminary Practical 
Procedures. 



Chitayat , , Linda 



An Evaluation of Computer- 
Managed Education Technology 
at New York City Community 
College, 



ED144524 



Computer Aided Learning Pro- 
ject: Repof^t, Trial 3. 



ED129281 



Dallman, Brian E. and 
others 



Evaluation of PLATO IV in 
Vehicle Maintenance Training- 



ED153638 



Devltt, Joseph J. 



Do Federally Funded Programs 
Really Work? The State View. 



EJ078922 



Durward, M. Lynne 



The Evaluation of Computer- 
Based Instruction in Vancouver 
Secondary Schools « 



ED088919 



Eastmond, Nick 



Instructior^al Development 
under the Microscope: Per- 
ceptions of Faculty Members. 



ED112882 



An Evaluation of Educational 
*?edia Prograidis in Kansas 
Unified School Districts. 



ED070291 



Roijs , Harvey L- 



An Evaluation of the Effective- 
ness of the Allen Teaching 
Machine at the Federal Correc- 
tional Institution, Lompoc , 
California. Final Report. 



ED043830 



An Evaluation of the Instruc- 
tional Television Program Basic 
Educalion: Teaching the Adult. 



ED128579 



Flaugher, Ronald and 
Knapp, Joan 



Report on Evaluation Activities 
of the Bread and Butterflies 
Project! . } 



ED097921. 
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Author(s) 



Title 



Accession Mo 



Fruchter, Dorothy A* and 
Hlgglnson, George M. 



Gaddis, G. Warren 



Grants William and 
Clark, Norma 



Cropper, George ^. 



Hall, Keith' A. and 
others 



Aarlen, Wynne 



Heflin, Virginia A, 
and others 



Hsia, Jayjia and 
Strand, Theresa 



ED085349 



An Evaluation Report of Proj- ED11(X)76 
ect INTERACT: A Teacher 
Inservice Training Course on 
Career Education Using Two- 
Way TV in Texas to Several < 
Groups Simultaneously. ^ 

Evaluation of Televised ED086186 
Electronics Instruction Program. 

A National Survey of Current ,and ED100073 
Anticipated Media Equipment in 
Residential and Day Programs for 
the Hearing Impaired, 

Development of Course Content^^ 
and Instructional Materials/ 
Aids for the Training of Educa- 
tioxtal Research, Develc^ent, 
Diffusion, and Evaluation Per- 
sonnel, Supplementary Final 
Report. 

Inservice Mathematics Education ED076043 
for Elementary School Teachers 
via Computer-Assisted Instruc- 
tion (California). Interim * 
Report. 

A Critical Look at the Classical EJ131787 
Strategy Applied to Formative 
Curriculum Evaluation. 

# 

The^Formatlve Period of LISTEN ED049019 
LOOK LEARN, a Multi-Media 
Comnunl cation Skills System. 

Helping Leaders Help Youth. An ED141000 
Evaluation Report of a Program 
for Illinois Volunteer 4--H 
Leaders, i973-75. 

WTTW-ESAA Television Pilot, ED129889 
"TCR '77,": Formative Evalu- 
ation . 



/ 



Individually Guided Education 
CIGE) Program. 197*4-1975 
Final Report. 

Initial Evaluation of Operation 
Wordpower. / 7 ** 
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Author (s) 



Title 



Accession No. 



Ironside, Roderick A. 



The 1971-72 Nationwide Installa- ^ ED066623 
tion of the Multiunit/IGE Model 
for Elementary Schools i A Proc-' 
ess Evaluation, ^ 



Johnson, Lary 



Johnson, Lary 



Johnson, Lary and 
Ostrum, Donald R. 



Klausmeler, Herbert J. 
and others 



Kulm, George 



The Fourth Ifear of IPX Mathe- ED114430 
inatics at Minneapolis Hall 
School: 1972-73. A Title I 
ESEA Project, 

Minneapolis IPX Mathematics ' ED083290 

Project 1971-72: Third Year 
Evaluation. A Title X, ESEA 
Project . 

« , 

Second Year Evaluatl<>n, XPI '^ED06787A 
Mathematics Project: Hall ^ 
School, 1970-71. 

A Report on the Utilizat;ipn^ of ED134559 
Individually Guided Mc^t^l^^iition. 
Technical Report No. 388. 



The Effects of the Two Summa- 
tive Evaluation Methods on 
Achievement and Attitudes in 
Individualized Seventl*-Grade 
Mathematics. 



ED090279 



Lambrecht, Judith J, 
and others 



LeinhardL, Gaea 



An Evaluation through Field 
Testing of Individualized 
InSitruction Materials in 
Wisconsin Post-Secondary 
Institutes. Final Report 
and Appendices. 

Program Evaluatioij: An Empir- 
ical Study of Individualized 
Instruction. 



ED069851 



ED131092 



Liebert% Roland J. 



Longo, Alexander A; 



r 



"The Electric Company'' In- ED094775 
School Utilization Study. 
Volume Two: The 1972-73 
School and Teacher Surveys and 
Trends since Fall 1973,. 

a!^' Sllniimative Evaluation of Cora-- ED074699 
puter Assisted Instruction in' 
U. S. Army Basic Electronics 
Training, Tei^hnical Report. 
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Author (s) 



Title 



Accession No* 



Lysiak, Fae and others 



Mack, Herschel and 
Li 1 1 1 e j ohn , S t ephen 



Mohrmann, Jeanne W. and 
Wise, Wilxn^r E. 



Moodie, Allan G. 



Murphy, Richard T. and 
Appel, Lola Rhea 



Nolan, Jeanne and 
Gross , John 

O'Bryan, K. G, 



O'Keefe, Ruth Ann 



Computer Assisted Instruction. 
197^76 Evaluation Report. A 
Title I Program. Revised* 

PS I as an Approach to the 
Teaching of Empirical Research 
Methods. 

Eval^tiation of Closed Circuit 
Educational Television in 
Delaware: Emphasis on Utlliza*^ 
tion, Program Series Content, 
and Commitment. Preliminary 
Report. 

An Evaluation of the "Drugs 
Are Like That" Program. 

Evaluation of the PLATO IV 
Computer-Based Education 
System ^n the Community 
College. Final Report. 

Mulligan Stew: An Evaluation 
of the Television Series. 

Monkey Bars Research Report. 
Report No. 46. 

Reports on the STARTER/ 101 
Pilot Project in the Reading 
Center of the D. C. Public 
Schools. 



ED140495 



EDX49408 



ED038033 



ED077951 



,"4 



EDU6235 



ED105889, 
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Methods Category 18: ^Distractor technique 



Hsia, Jayjia arid 
Strand, Theresa 



WITW^ESAA Television Pilot, 
VTCR '77 ": Formative Evalu- 
ation. 



ED129889 



Methods Category 19: Audience rating systems 

Samuels, Bruce, Comp. The First Year of Sesame Street: ED047824 

A Summary of Audience Surveys, 
Final Report, Volume IV of V 
Volumes - 
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Metho ds Category 20: Essays/personal statements 

Hsia, Jayjia and WTTW-ESAA .Televlslan Pilot , ED129889 

Strand, ITieresa "TCR '77 ": Formative Evalu- , • 

' • ation, 
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♦ SOME ADDITIONAL WORK 

This document represents an initial ^tep toward making evaluations 
of instructional technology more accessible to researchers and practitioners. 
It is in many ways a rather crude step» dependent as it was on abstracts. ^ 

• Unfortunately, merely classifying information has limited value in 
answering questions such as: 

1. What is phe status of our use of instructional teqhnology^'" "y' 
both domestically and internationally? What wo.rks, for 

whom, under what conditions^ and with .what costs? 

2. How effective are our efforts to evaluate? 

3. What remains to be investigated, 'and with what approaches? 
Perhaps the global nature of these questions precludes meaningful responses. 
Pursuing such inquiries may succeed only in frustrating developers and con- 

( ' - . ' ■ 

sumers alike. 



There^'are, however, some intermediate questlc^ 
more reasonably, although not without difficulty. 



i^u 



ns that c^uld be pursued 
For example: 



1. To> what extent do the evaluation studieq of instructional 
technology included in ERIC me^t standards of quality? 
Where might such standards, originate? 

2. To what extent and in what ways might these studies be 
useful, and to whom? What characteristics must such 
studies possess if they are to be useful , to those not 
included as original audiences for the evaluat^j^ns? And 
if such studies cannot be rendered useful^ should they 
be in the ERifi system? ' ' 

3. How successful has ERIC been in getting important evaluation 
"Stud ies into the system? 

4. ^ Do the categories used in this paper represent possible ^, 

new descriptors for the ERIC system? 

It may bo useful to conduct a^f le^t two additional activities related 



— I 

0 this project, Fjrst, It would 1 



to this project, Fjrst, It woul^ be most Interesting to sainplfi, from the 
universe Qf evaluation studies rjfeviewed herein, 50 - 75 of the ytudies for 
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njoreln depth analyses. And second, it may be.useful to conduct a small 



.evaluation of the usefulness of this small reference work. 






n 
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APPENDIX A 

Citations related to critiques 
of evaluation methods or 
evaluation plans 



This appendix lists documents identified as , reviews or critiques of 
an evaluatiox) method/technique thought useful In- evaluating ijjxsrcr^ictienal 
technology, but, not (as docximents) evaluation studies of instructional - 

technology. Eval^ation .plans and/or research designs aife included, as 

* , *' ' . * • ' . ■ 

well as specific assessment criteria. ' 



Author (s) 



Title 



AccBsjrion "No. 



Black, James 



Bramble, William J., Ed, 



Brelaiid, Hunter M. 



Bur^:, Gordon 



Call-Hinivich, Eileen 



Co Idtjv in, Gary ' D. 



Connolly, A. J. 



Individualized fnstructiqn — . VEJ076415 
A Rating. Pro file. 

Fomiative Evaluation ^Study for* "EDIOBOOS 
AESP Diagnostic and Prescript , 
tive Reading Course. JL^chnlcal" 
Report Number Three. , 

Planning»for the Evaluation of ED091448 
the Plato Computer-Based Instruc- 
tional System: Attitudinal and 
Performance Evaluation in the 
Elementary Schools. . ' , 

Detailed Evaluation and Content EJ153917 
An,alysis. ' ^ ' 

-> . ' 

An Assessment of Lesson Review , ED1407 7 5 
as. a Fprmatlve Evaluation Tpoi. 

Spaced, lilassed, and Summary . EJ136438 
Treatments ^ ad Review Strategies ■ , . * 
for ITV Productiort. ^ . ^ 

The Contribution of an Internal ' 4^:1)1.15231 
Review Panci^ to the Dcvc'l.opment 
of Educat ional Frpgramming . 
Satellite Technology Demonstra- 
tion^ Technical Report No. 0213-' , 
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Author (js) 



Title 



Accession No. 



Dole, PhyUis W, 
EPIE 



A Design to Study the Effective- 
ness of Individualized Instruc- 
tion in the Teaching of Reading 
and Mathematics. 
' • .# 

The Product Improvement Process. 

Looking Ahead: Selection Kits 
Will Blunt Buying Blunders. 

Evaluating Sedia Pro-ams: . 
District and School.- A Method 
and an Instrument* 

Field Manual for Administration 
of the Individualized InstVuC-- 
tion ^cale; Febrtiary 1974 Re- 
vision, 



ED117217 



ED101692 
EJ034497 

ED136832 
ED090986 



Frase, Larry E, 



Product Validation; 
or: Panel Review. 



Pilot Test 



EJ102922 



Fulton, W. 



Fraley> Lawrence E., Jr , 



Georgiades, Constance 



Harvey, William 



Hillelsohp, Michgel 



Jones, Les A, 



Evaluative Checklist: An Instru- ED078653 , 
ment for Self-Evaluating an 
Educational Media Program in 
Colleges and Universities. ^ 

Chart-llecorded Capillary Pulse ED032784 
Pressure Measurement as an 
Undbtrusive Means of Detecting 
Unspecified Frame-Specific Flaws 
in Prograimed Instruction Se- 
quences:" An Experimental Study. 
Final Report. 

Individualized Evaluation for EJ076196 
Individualized Learning. 

A Yardstick for Individualized EJ076416 
Instruction. 

Student-Initiated Reports: ED076005 
Operational Analysis in the 
Evaluation of CAI Curricula. 
Professlonnl Paper No. 15^74. 

A Plan for J:he Evaluation of a ED127929 
Project to Develop Basic Medical 
Sciences Lessons on Plato IV. 



V 



90 



ERIC 



9 7 



A 



./ 



Author (s) 



Jung, Steven M. 



Ka9das(wamy , Subramanias 



Kemel field, Graeme 



'Krus, \Patricia H. 



7^ 



Title 



Accession No, 



tional 'Materials. 



' Evaluative, Uses of Uncohven- * Ej642347 
tional Measurement Techniques 
in an Educational System, 

I^earner Verification and " ijl53932 
* s Revision : An Ebcperimental 
Cbaparison of Tvo Methods • 

The Evaluation of Schools' ED0^6870 
Broadcasts: Piloting a New 
Approach. ' I 

Sunnnative Ey&luation of Instruc- , EJ174739 



Laws on, Tom £, 



Light, Judy A. 
l\ngo, Alexander A. 



McConnell, David 



Nathenson, Michael B, 



Formative Instructional Pro- ED089765 
duct Evaluation; Instruments 
and Strategies, * * 

^The Method of "Strong Inference" ED091441 
In the Design of Evaiiiation 
Studies^ 

Preliminary Evaluation Plan ED094736 
for U. S. Army Computerized 
Training System Report No, 
CTS-TR-74-1. 

Stimulated Recall: A Method ^ ED154833 
for the Analysis and Improve- 
ment of 'Individualized 
Instructional Systems, 

Developmental Testing Really^ EJ1837^4 
Does Work, 



Niedermeyer, Freji C. 



Observation Procedures for ED106887 
Classroom Tryout of Instruc- 
tional Materials and Procedure^^ 



Parer, Michael S 



FormatEvie Evaluation and Instruc- ED124166 
tional* Television; The Need , ' 
Problems, and Instruments* 



Pl^ot Guidelines for Improving 
InstVuctlonal Materials through 
the Process of Learner Verifica- 
tion and Revision, 



ED112822 



Preliminary Data from the 
Progress Testing. 



ED122818 
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Sabar, Naama 



Sanner, Richard L, 



Sherman, Thomas M. 



EJ15610A 



Proposed Research Program ED095815 
(Part A: Technical Narrative) 
on Assessment and Analysis of . 
Education SateJJite Comsainica- j 
tions Demonstration, Pharfe III. 

\ - 

The Utility of Various Kinds ^ 
of Evaluation Data in the Proc- 
ess of Developing New Biology V . 
Science Curr.iculum. 

Evaluation of Educational Media EJ104571 
Programs — By Faculty. 

A Formative Approach to Student ED08895A 
Evaluation of Instruction. 



Stolovitch, Harold D, 



Thiagarajan, Sivasailam 



Shaping Special Education ED1*3309 
through the Intermediate. 
Technology of Learner Verif ica- * 
tion and Revision. 

A Study of the Effectiveness of ED115717 
Individualized Instruction in 
the Teaching of Reading and 
Mathematics. Final Report: 
The Study Design. • 

Learner Verification and Re- EJ131257 

vision: What, Who, When and 

How. . . t 



UnKs, Nancy 



A Plan for Evaluating 
Testing Program. 



the' IPI 



ED036188 



Valdes, Alice L. 



Walton, Wesley W. 



A, Design to Study the Effec- ED117215 
tiveness of Well-Implemented 
Individualized Instruction in 
Compensatory Reading and Mathe- 
matics Programs*. Final Report. 

Selection of Exemplary Educa- ED083291 
tlonal Products. Panel Review 
of Products, 1972-1973. 



Yawkey, Thomas D. 



Evaluating^ Instructional Goals 
of Developmental Programs in 
Early Childhood Education. 



EJ 13 05 13 



, APPEHDIX B 

Citations related to critiques 
of evaluation studies 



This appendix lists dociwents which provide an analysis of an evalu- 
ation study, for purposes of drawing inferences about design, methodology, 
etc.; an attempt to aggregate data across evaluation studies; or a response 
to an evaluation study. 



Author (s) 



Title 



Accession No, 



Ball, Samuel 



Bertou, Patrick 



Biianton, Bill 
Bogatz, Gerry Ann 

Bogatz, Gerry Ann 



Brlghtman, Richard W. 



Cooney, Joan Ganz 



A Summary of the Major Find- ED115679 
ings frQ|i ''Reading with Tele- 
vision: An Evaluation of the 
Electric Conqpany." 

An Analysis of the Relative EJ059153 
Efficacy of i^vanced Organ- 
izers, Post Organizers, Inter- 
spersed Questions, and- Gombina- 
tions Thereof in Facilitating 
Learning and Retention froia a 
Televisfi'd Lecture. 

How Effective Is Sesame Street? „EJ057095 

Some Things You've Wanted to EJ034482 
Know about Sesame Street* 

A SuEHoary of the Major Fin*- ED122802 
ings in "The Second Year of 
Sesame Street: A Continuing 
Evaluation." 

Strategies for Change; A Case. ED051806 
Study of Innovative Practices 
at the Coast Community College 
District. 

i 

Five Years, of "Tlie Electric ED122805 
Company. " 



93 



Author (s) 



Title 



Accession No* * 



Cooney, Joan Ganz 



Cowlan, Bert 



Friedlander, Bernard Z. 



Gill, Clark C. 



Hamilton, Jack A, 



Lelnhardt, Caea 



Lumsden, Barry 



Mueller, Daniel, J; 



Nltko, Anthony J- 



Oettinger, Anthony "G. 



Sesame Street at Five; the 
Changing Look of a Perpetual - 
Experiment. 



m22804 



The ATS-6— American Case Studies. EJ133000 



Ep^ielogue. Evaluating Instruc- 
tional Systaas. 

Evaluating Instructional Systems; 
EPIE Educational Product Report. 

Ijew England Instructional 
Television Research Center. 

Development of Guidelines and 
Resource Materials on Latin 
America for Use in Grades 1-12. 

Conmunicating Current Informa- 
tion on^ Career Education by 
Audio Cassette. 

Implications of the Alaska 
Education Satellite Coimunica- 
tions demonstration for Tele- 
coianunications & Education 
Policymalcers. 

Program Evaluation: An Empir- 
ical Study of Individualized 
Instruction, 

Programed Instruction: Too 
Many Unanswered Questions. 

s 

The Mastery Model and Some 
Alternative Models of Classy 
room Instruction and Evalu- 
ation: An Analysis. 

Measurement of Instructional 
Outcome vs. Measurement for 
Instruction: A View of IPI 
Testing Procedures. 

Educational Technology: New 
Myths and Old Realities. 



EJ092659 



ED097304 



ED109981 



ED033143 



EJ178915 



ED144572 



EJ180514 



EJ127192 



EJ079044 



ED036185 



ED034423 
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Author (s) 



. Titles 
'■■ill p I 



Accession No« 



Royce, George 



Ruff, Frances K. 



Schoen, Harold 



Spr ingle, Herbert. 



Stutzman, W. L. 



Wykes, James 
Zitnmer, A. L. 



Prograxmned Instructional 
Materials f ot Adult Basic 
Education: An Empirically- 
Based Evaluation of Materials 
Developed by the Adult Learn- 
ing Center. Final Report. 

Scorecard for Individual,! zed 
Instruction. 

Problematic Jsisues Related to 
Systematic Teaching of Affec- 
tive Skills. 

Self-Pace^ Mathematics Instruc- 
jtion: Wow Effective H^s It 
Been in Secondary and Post- 
secondary Schools? 

Mho Wants to Live on Sesame 
Street? 

State Education Department 
Coment c5h ''Educational Tele-* 
vision in New York State." 



A Multimedia Approach to 
Remote Classroom Instruction. 

Summary of Closed Circuit 
Televisiprt Activities In 
Medical Education. 

Taking Stock. 

Community College Users' 
Report, Fall 1975. 



ft 



ED103569 



EJ128430 



ED151362 



EJ140102 



EJ071399 
ED083827 

EJO86904 
ED031918 

EJ022402 
ED122901 
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APPENDIX C 



CltatiooB related to conceptual 
^ papers in evaluation 



These documents are* concerned with general conceptual or theoretical 
issues related to the evaluation pt inatructional technology rather than 



critiques of ^particular methodologies.. Attempts to construct models of 
evaluation are Included. 



Author(s) 



Titles 



Accession No. 



Abedbr 




Abedor, Allan and 
Fustafaon, Kent 



Aldferm^n, Donald 



Development and Validation ED064327 
of a Model for Formative 
Evaliiation of Self-Instruc- 
tional Multi-Media Learning 
Systems. i, - ^ 

Evaluating Instructional ' EJ051771 

Development Programs: Two 

Sets of Criteria. ^. 

Framework for the Educational ED103488 
Evaluation of Computer-Assisted 
Instruction. j 



Alkin, Marvin C. and 
Wingard, Joseph 



Alkin, Marvin C. and 
Wool ley. Dale C. 

Aversa, Frances M. and 
Forman, David C. 

Aviss, Julian 



User Oriented Product Evalu- 
ation, 

A (Framework for ^Evaluation of 
TESOL Programs, 

Issues in the Evaluation of 
Educational Television Programs* 

The Description of a Faculty 
and Course Evaluation Scheme. 



ED067899 



ED038648 
f 

f 

EJ179589 



ED146862 



Bailey, K. V. 



Baker, Eva L, 



Evaluating School Radio and EJ079070 

Television: Some Problems and 

Methods, 

Formative Evalyation of Instnic- EB123239 
tion'. 



Author(8) 



Title 



.^Access ion No. 



f B^ker, Eva an<i 
AXld^H^Marvin 



jihrbatsiil, Grecchen Schoen 



Bjerstedt, Ake 



Blaney^ John P. 



Boucher, Brian G. and 
others 

Carpenter, C, R. and 
Froke, Marlowe 



Clark, R. J. and others 
Cooley, William . 
Cunningham, Donald 

Day, Joseph A, 
Day, Michael 



Deprospo, Ernest R. and 
Liesener, James W. 

Epstein, Kennefh I, 



ERIC/AVCR Annual Review Paper: EJ091462 
Formative Evaluation of 

Instjuctional Etevelopment • - 

The Nature of Inquiry and ED119276 
Analysis of Theoretical Pro- 
gress in Instructional Tele- 
vision from 195Q-1970, 

System Modification and Evalu*- ED051676 
ation in Instructional Pro- 
gramming : The Final Phase of 
the Program Cgnstruction 
Process. 

The Application of Formative ED062608 
and Summative EvaluaHflon 
Techniques to Short Term 
Adult Education Courses. \ 

Handbook and Catalog for ED0772ia 
Instructional Media Selection. 

Description of a Practical ED037102 
Procedure for Assessing 
Instructional Film and Tele- 
vision Programs. 

A Case Study in Canadian EJ174930 
Curriculum Materials Analysis. 

Methods of. Evaluating School ED057087 
Innovations." < - 

Formative Evaluation of ED051263 

Repllcable Forms of Ins true- ' 

tion. 

The Pitfalls of Evaluating EJ139698 
Instriictional Materials. 

The Use of Fotmative Evalu- EJ092235 
ation in the Art Classroom. 

Media Program Evaluation: "A EJ136468 
Working Framework. 

Sequential Plans and Formative ED109i8S 
Evaluation. 
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Hepdersor^^ Evan C. and 
.Nathenson, Michael B. 



Herrel, Jean G,^. • 



Hodgkinson, Harold L. 
Ingersoll, Gary 
Klein, M. Frances 

Klein, Stephen 
Koinoski, P. Kenneth 
Kreimer, OsValdo 



Krus, Patricia H, 
and others 



Lewis, Richard F. 



Light, Judy A. 



The Evaluation of Continuing 
Education via Television. 

Guidelines for Analyzing Kits/ 
Sets of Ea^ly Learning Materials. 

Developmental Testing: An 
Empirical Approach to Cpurse 
Improvement, 

Instructional Television in 
Belgium, Proposal and Experi- 
mental Evaluation of an Apprq- 
priate Design for Effectiveness 
Research and Possibilities for 
a New Strategy in Program 
Evaluation. 

Evaluating Individualized 
Learning. 

Sesame Street Can* t, Handle 
All t^he Traffic. 

A Perspective on Improving the 
Effectiveness of Curriculum 
Materials. ' ' 



/^EJ042336 



EJ058898 



EJ153916 



EJQ65912 




Procedures for Xompar ing 
Instructional Programs. 

Statement before Select 
Subcommittee on Education, 

Open, Sesame: A Key to the 
Meaning of the Educational 
Broadcast Message. 

Formative Evaluation Design ♦ 
for Assessing Instructional 
Materials . 

How to Improve a Television 
Series by Formative Evaluation. 

Formative Evaluation Procedures 
for the In^Context Development 
of Instructional Materials. 



EJ119679 



EJO458I7 

t 
I 

EDl072ia. 

ED061271 
ED059612 
ED102964 

EJ143961 

EJ 17 099 5 
ED065557 



Lindvall, C. M. 



The IPI Evaluation Program. 



ED036194 
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Author (s) 



Title 



Accession No 



LindVall, M. and 
Cox, Richard C, 



Lindvall, C. and 
Cox, Richard C. 



Lohnes, Fanl R. 



Mace, Ellie 



Markle, David G. 



McCoy, David 



McGuigan, J. 



Mitzel, Harold E. 



Moomaw, W. Edward 



Myers, Sheldon S. 



Niedermeyer, Fred C.,,Ed, 



Olien, C. N. and others 



Palmer, Edward 



The Role of Evaluation in EDO35302 
Progtaas for Individualized 
Instruction. ^ * 

A Rationale and Plaii for the ED036179 
Evaluation of the Individually 
Prescribed Instruction Project, 

Planning for Evaltiation of the ED061776 
LRDC Instruction Model, 

"Rolling. Remake;*: An Alterna- EJ153915 
tive Approach \^o Course Design 
at the Open University. 

In Which It Is Demonstrated EJ089802 
That a Program That Works May 
, Well Be Worthless.* 

Continuous Evaluation of EJ104572 
Instructional Media Services 
at Eastfield College, 

How to Select and Evaluate ED051455' 
, Programmed Instructional 
Materials^ * . ^ " 

How to Evaluate Computer EDO47005 
.Assisted Instruction. 

Practices and Problems in EJ159075 
•Evaluating Instruction. 

Issues and Technical Problems EDO47O04 
in Research and Evaluation 
Related to Innovative Mathe- 
J matics Projects. 

Prototype Testing in Instruc- ED133337 
tlonal Development. SWRL Work- 
ing Papers: ^^^2* • ' 

A Social Systems Approach to ED114431 
Evaluation Research. 

Formative Research in the ED071434 

Production of Television for 

Children. 
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V 

Passmore, David Lynn 



Popham, W. James 



Title 



Accession No. 



Shaw, Morley i 



Singh, Jai P. and 
Morgan, Robert P. 



Skager, Rodney W, 



Stolovitch, Harold D, 

Swisher, Ginny and 
others^ Eds. 



Tognetti, Ann 



Wager, Walter 



Ward, Marjorie Ellen 



Information Needs for Forma^ EJ178898 
tive Evaluation of Career 
Education Products • ' 

Program Fair Evaluation— • ED110514 
SuBsnative Appraisal of 
Instructional Sequex^ces 
with Dissimilar Objectives, 

Second Seminar on Direct ED038590 
Teaching by Television/ ^ 

Philosophy and Methodologies ED092190 
for th^ Evaiuatipiib of Innova- 
tive arid Nontraditional Pro- 
grams. A Report of the National 
Dissemination Project for Post- ^ 
Secondary Educatibdr. 

Computer-Based Instruction: A ED055429 
Background Paper on Its Status j 
Cost Effectiveness and Tele- 
communications Requirements. 

Student Entry Skills and the ED05A232 
Evaluation of Instructional 
Programs: A Case Study. 

Formative Evaluation of EJ143315 
Instructional Games. 

Evaluation: Processes and ED036913 
Practices. 

Symposium: Perspectives on ED144978 
Formative Evaluation of 
Children* s Television 
Programs. ^» 

The Evaluation of Instructional ED140457 
Programs. 

The Formative Evaluation EJ148469 
Outcomes Matrix. 

Examination and Application of ED076056 
Formative Evaluation for Author 
Utilization during the Prepara- ^ 
tion of a CAI Course. 
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Ward, J^rjorie E. and 
Cartwrlght, G. Phillip 

Webster, Williasj J. and 
Mendro, Robert L« 



Wlersma, William 

(I 

Wile, Marcia Z. 
Willoughby, Stephen S, 



Some Contemporairy Models for 
Curriculum Evaluations. 

Tke Investigation of Aptitude 
Treatment Interactions as an 
Integral Part of Program 
Evaluations, 

Eva luatlngv Instructional - 
Effectiveness- 

An Evolving Product Evaluation: 
Formative and Summative 
.Components. 

Individualization . 



ED08123& 
EJ106864 



EJ14S98)& 



ED093909 



EJ140100 
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Vbisliogsaphy / ' . ' ' 

Adler, Leta MaKinney ^ind cjthei^,;- Ev^luarjlon af Progtaxaiaed Instruction 
Techniques in/Me4ical tnteWleving^ Fina-1 Report, June 15, 1966 to 
June 15 r 1968 . University of Southqya Califqmla, tos Angeles, Depart- 
wf^iit of Psychiatry. 1972, 6p/, ED 059 345. / ^ ^ . . 
' " ^ > ^ ' ^ ^ ^ . ' ' , 

Since the medical interview is usually eonsideted to be the basis 
of vail .'diagnosis and treatment in medicine, this study inveftlgated 
alternative ways of improving medical interview techniques. To 
tQ^t the hypothesis •that the Visual (vide*otape) technique would be 
more effective than 'the lecturiijg or Audiotape techiUque, 12 
videotaped interviews werp condi^cted between a physician and 
various^ |^ofi»4?si^^ mo^ls who served as patients, and a post- 
^raduiil^^U^ medical interviewing was developed. At the fend 

of the course, an evaluation was made of the content-learning gain 
and al^ of the attitudinal changes in training. The programmed 
instruction in medical interviewing was" found' to be as effective 
as two alternative instructional methods in meeting its teaching^" 
goals > and the evidence suggested that it was more effective. 



Ail^ Stephen A. ajad Stegeman, William H. , Eds. To Establish, Operate and 
Maintain Supplementary Educational Sfervjces: Instructional Television 
Experience Development and Distribution. An Evaluation of San Diego Area 
Instructional Television Authority Educational Program Activities ; 
September 1, 1968 to June 30, 1969 * San Diego Area Instructional Tele- 
vision Authority, CA, 1969, 299p. Available from Stephen All, , San Diego 
Area Instructional Television Authority, 5164 College Ave., San Diego, -CA 
92115. ED 038 031.* . . 

The Contents of this report Represent a digest of activities from 
the organization's inception in 1966 to 1969 when the Title III 
grant expired. Each y^ar the authority provided instructional ^ 
television to some 250,000 sttidents and teachers. The report 
includes such information relating to organizational structure 
as the joint powers agreement that supplied a legal framework fox 
authority activitios, an organizational xhart, 3nd minutes from 
the -various committee meetings. Program selection and production 
procedures are reviewed. Statistics concerning the increases in 
television equipment and information reflecting the manner in 
which production and broadcast of programs have been handled are 
provided. The results of an authority-conducted program evaluatidn 
study are analyzed, and samples of the various typ'es of information 
disseminated to educators concerning the program are .given. Back- 
ground information i<A supplied on a series on drug abuse produced 
for the San Diego Unified School District and a series on physical 
geology produced for three local junior colleges. Further plans 
f%r the project are discussed, and fetters of commendation received 
by the authority are {^resewcrfed. 
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Altschuld, 5aMes W. and iPritz, Ssndra, Planning Construction Prof j acts i 
An Evaluation Reports for the Occupational Eyploratlou Progra^ ^ Ohio State* 
University, Columbus, Center fpr Vocational and Technical Education, 1974^ 
156p. EeQ^504. • . '\ - * . ' ^ ' . 

The evaluation report is one of seven product for the Occup^^tlonal 
••Exploration Prograia (OEP) , a series of simulated occupational, experi- 
ences designed for junior high' school students. Describing the pilot 
testing of the simulation dealing with construction, th^ report con- 
tains sections describing the simulation context, evaluation procedures, 
results, and a Reviser's Information Siuaaary (RIS) • In the simulation, 
students planned a new junior-^ig^x athletic facility. Occupational 
roles includ^ architect, jimior architect, civil engineer, draftsman, 
1 community representative, board of education representative, and 
superintendent of schools. The experimental design involved two 
Colorado schools, with a total of four experimental and four control 
groups involving 92 eighth and ninth graders. Instrumentation included 
knowledge and affective testing, student and teacher questionnaires,, 
and a panel review. Analysis of variance and other descriptive statis- 
tics were employed, and reliability estimates were calculated. Analysis 
of variance results revealed that the Simulation had a positive impact 
on student occupationai knowledge, but no statistically significant 
impact on occupational preferences. The RIS records and extrapolated 
trends relate to the strengths, weaknesses, and recommendations fro^n 
all data sources. Appended materials include the evaluation instru- 
' ments used and the teacher log. ^ 

Altschuld, Jam^ W. and Fritz, Sandra. Planning Educational Programs; An ^ 
Evaluation Report for the Occupational Exploration Program . Ohio State 
University, Colu«bu3, Center for Vocational and Technical Education, 1974,- 
UOp. ED 106 503. 

The evaluation report is one of seven pr^uced for the Occupational 
Exploration Program (OEP),^a series of simulated occupational experi- 
ences designed^for junior high school students. Describing i:he pilot 
testing of the simulation dealing with education, the report contains 
sections describing the simulation context, evaluation procedures, 
results, and a Reviser/s Information Sumnary (RIS). In the simulation, 
students worked on the design and development of a school for space-- 
ship Scorpiial^ about to take a long voyage in space. The, occupational 
roles simtjilated Included educational researchers, cons,ultants, 
community members, and other student-selected educ^itional roles. The 
experimental design involved two Colorado schools, with a total of 
four fejtperimental and four control groups involving 97 eighth and 
ninth graders. ^Instrumentation inclyded knowledge and affective 
testing, student and teacher questionnaires, and a panel review- 
Analysis of variance and other descriptive statistics were employed 
and reliability estimates were calculated. Analysis of variance 
results revealed that the simulation had a positive impact oi\ student 
occupational knowledge^, but no impact on student occupational prefer- 
ences. The RIS- records and extrapolated trends relate to the 
strengths, weaknesses ^ and recommendations from all data sources . 
Appended materials include the evaluation instruments used and the 
teacher log. 
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Altsc'huld. James and others. Creating an Advertiglng Caapalgn; An 
^ Evaluat ion Report fot the Occupati cmal Sxploration PrograAs,, Ohio State- 
University. Columbus, Center for VociftionaX- and Technical Education, 1974. 
134p. ED 106 507. ' * • . ' . 

( . ■ ■ ' . ' - ; : . 

' The evaluation report, is one of seven produced fbr the Occupational 
Exploration Program (CEP), a' series of simulated occupational experi^ 
ences designed for, junior high school students. Describing the pi^ot 
' testing of the simulation dealing with advertising, &he report con-. ' 
tains sections describing the simulation context, evaluation proced- 
ures, results, and a Reviser 's Information Si^aaary (RIS) . In the 
simulation,- students utilized market research findings to develop- 
magazine advertisements and radio arid teleyision commercials for the 
product. Saddle . an indoor skill game. Occupational roles included 
account executive, market/media research positions, graphic/ layout 
artists, TV/radio producers, and audio technician." The experimental 
design involved two Colorado schools, with a total of four experimental 
and four control groups involving 82 eighth and ninth graders. Instru- 
loentation included knowledge aqd affective testing, student and teache* 
questionnaires, and a panel review. Analysis of variance and other 
descriptive statistics' were employed, and reliability estimates were , 
calculated. Analysis of variance results revealed that the Simula- . 
tion had a positive impact on student occupational knowledge and 
preferences. The RIS records and extrapolated trends relate to the 
strengths, weaknesses, and recommendation^ from all data sources., 
Appended materials Include the evaluation Instruments used, observer 
form, and an example of student product., 

Altschuld, James W, and others. The Health a nd Welfare Moduli An. Evalu- 
arion Re port for the Occupational Ex ploration Program. Ohio State Univer- 
slty, Columbus, Center for Vocational and Technical Education, 1974. 126p. 
ED 106 509. 

» 

The evaluation report Is one of seven produced for the Occupational 
Exploration Program (CEP), a series of simulated occupational experi- 
ences designed for junior high school students. Describing the pilot 
testing of the simulation de;allng with health and welfare, the report 
contains sections describing the simulation context, evaluation pro- 
cedures, results, and a Reviser's Information Summary. (RIS)-. . In the 
• simulation, students assumed the responsibilities of health and 
welfare workers\ in a drug treatment center. The occupational' rabies 
included a director, physician, psychologist, medical technician, 
pharmacologist, nurse, probation officer, and social workers. The 
experimental design involved two Colorado schools, with a total of - 
four experimental and four control groups Involving 73 eighth and 
ninth graders. Instrumentation included knowledge and affective 
testing, student and teacher questionnaires, and a panel review. 
Analysis of variance and other descriptive statistics were employed, 
and reliability estimates were calculated. Analysis of variance 
results revealed that the simulatioa had a positive impactv.on student 
' . occupational knowledge. No statistically significant results or 

changes in occupational preference were noted. The RIS records and 
extrapolated trends relate to the strengths, weaknesses, and recommenda 
tions from all data sources. Appended materials include the evaluation 
instruments used and an observer form. ^, 
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Altschuld, Jaaes W. and others* Insurance; An Evaluation Report for the 
Occupational Exploration Program . Ohio State University, Goltujibus, Center 
for Vocational and Technical EduQation, 1974, 146p. ED 106 508, 

The evaluation report is 6ne of seven produced for the Occupational 
^Exploration Progr^ (OEP) , af series -of simulated occupaitional experi- 
ences, designed for junior highjschool students. Describing the pilot, 
^ testing} of the simulation dealing with the insurance fields the report 
contains sections describing the simulation context, evaluation proce- 
dures, results, and Reviser's Information S ummary (RIS) • Xn the sitmila"^ 
tion, students operated an automobile insurance company^ prscessing the 
\ claim resulting' from a "client^s" autoqpblle accident. Occupational 
roles included agent, client, reviewer, inspector, underwriter, witness, 
rater, claims adjuster,- claims exai&iner, and actuary. The experimental 
design involved two Colorado schools, with a total of four experimental 
and four control groups involving 79 eighth and ninth graders. Instru- 
mentation included knowledge and affective testing, student and teacher 
questionnaires, and a panel review. Analysis of variance and other . 
descriptive statistics were employed, and reliability estimates were 1 
calculated. Analysis of variance results revealed that the sisjulation 
had a positive impact on student occupational knowledge and preferences. 
The RIS records and extrapolated trends relate to the strengths, weak- 
nesses, and recoimnendations from all data sources. Appended materials 
include the evaluation instruments used and an observer form. 

Altschuld, James W. and others. Manufacturing Production; An Evaluation 
Report for the Occupational Exploration Program , Ohio State University, 
Columbus, Center for Vocational and Technical Education, 1974, 153p. 
ED 106 506. ^ ' 

The evaluation report is one of seven produced for the Occupational 
Exploration Program (OEP), a series of simulated occupational experi- 
ences designed for junior high school students. Describing the pilot 
testing of the simulation dealing with manufacturing production, the 
report contains sections describing the simulation context, evaluation 
procedures, results, and a Reviser's Information Summary (RIS). In 
the simulation, students set up and put into operation a 38-step 
assembly line producing extension speakers for transistor radios. 
Safety rules, administrative procedures, and job training were intro- 
duced. Occupational roles included supervisory positions and assembly 
line production* The experimental design involved two Colorado schools^ 
with a total of four experimental and four control groups involving 77 
eighth and ninth graders. Instrumentation included knowledge and affec- 
tive testing, student and teacher questionnaires, and a panel review. 
Analysis of variance and other descriptive statistics were employed 
.and reliability estimates were calculated. Analysis of variance 
results revealed that the simulation did not have a positive impact on 
student occupational preferences. The RIS records and extrapolated 
trends relate to the strengths, weaknesses, and recommendations from 
all data sources. Appended materials include the evaluation used and 
a teacher evaluation log. 
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Altschuld, Jfa»es W. and others. Product Services Modu3.g; An Evaluation 
Report for the Occupational Eacploration-ProRram . Ohio State University, 
Colufflbua, Center for Vocational and Technical Education, 1974^ l2Ap. 
ED 106 505, ^ 

The evaluation report is one of seven produced* for the Occupational 
Exploration Program (OEP), ^ series of simulated occupational experi- 
ences designed for junior high school students • Describing the pilot 
testing of the simulation dealing with product services » the report 
contains sections describii}g the simulation context, evaluation-pro-" 
cedures, results^ and a Reviser's Information SufflBMiry (RIS). In the 
simulation dealing with bench electrical repair, students had the 
opportunity to repair defective transistor radios, provide^ supplies 
to product service personnel, or direct other product service workers. 
Occupational roles included foreman, repairman, and supplyman. The 
experimental design involved two Colorado schools, with a total of 
four experimental and four control groups involving 87 eighth and 
■ninth graders. Instrumentation included knowledge and affective 
testing, student and teacher questionnaires, and a panel review. 
Analysis of variance and 'other descriptiye statistics were employed, 
and reliability estijn^tes were calculated'. Analysis of variance^ 
.results revealed that the simulation had a positive impact on both 
the student ^s occupational knowledge and occupational preferences. 
The RIS records and extrapolated 4:r ends relate to the strengths, 
weaknesses, and recoimnendations" from all date sbjirces. Appended 
materials include the evaluation instrument used .and the observer 
form* 




Amarel, Marianne and others. The Introduction of Innovative Inst>ructional 
Systems; Implementation aqd Program Evaluation. Section 1. The Ryactl- 
'tioner; Select ion. Training, and Program Evakiation; Section 2. Degre e 
of Implementation and Classroom Observation . Presented at the annual \^ 
meeting of the American Educational Research Association, Washington, DC,^ 
March 30 - April 3, 1975, 51p. ED 118 619- 

The University of Illinois' PLATO Elementary Program, which'was 
observed and evaluated for two years, was tfie focus of Part 1- The* 
major PLATO features were' described and the PLATt) elementary reading 
and mathematics demonstrations, representing attempts at sequential 
and concurrent hardware, software, curriculun^, and implementation 
development of tutoi^ial computer 'assisted instruction, 'w^e emphasized 
The PLATO staff was composed of volunteers because of the perceived 
importance of teacher commitment to the program. This method of 
selection caused several problems. The orientation of PLATO staff 
varied with implementer * s views of proper teacher contribution to 
the program. Judgments on the effectiveness of teacher orientation 
and the relationship between that process and the eventual development 
of the innovation were inconclusive. In Part 2, the theoretical com- 
ponents of the degree of PLATO implementation and classroom observa- 
tion were discussed. An effort to sketch the evolution of one of the 
observation instruments being employed to observe the effects of PLATO 
on the life of elementary classrooms^ includes the conditions and 
hypotheses under which it had been deve-loped and used, and one illus- 
trative result concerniiig implementation. 
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Analyses of Ba«ic and Supplementary Reading Materials. An In Depth Report, 
Educational Product Report: So« 64 V8, nl^ p5-109. Sep-Oct 1974. 
EJ 107 290. . " 

Analyz&s 76 commercially marketed reading materials and ^provides 
deS^criptlons of the curriculusj role (whether basic or su^plesoentiary) , * 
the target population^ the instVuctioiial approach, and the product's 
coinponents. A summary of the fillings includes the analysts* overall 
opinions of the materials • * 'A price list is provided. 

Anastasio, Ernest J- and Alderman, Donald L, Evaluation of the Educational 
Effectiveness >of' PLATO and TICCIT . Educational Testing Service, Princeton, 
NJ, 1973. 13p. ED 088 934/ 

This evfi^luation of the Programnied Logic for Automatic Teaching -Opera- 
tions (PLATO) and Time-Shared Interactive Computer-Controlled Informa- 
tion Television (system) (T-ICCIT) programs focuses on their costs, 
performance and educational effectiveness. The cost component attempts 
to measure the costs and assess the economic effects of each of the 
systems on the participating educational institutions. The tecjinical 
component monitors the performance of each of the two systms so as 
to discover and explain strengths, weaknesses, and implications for 
further, use. The educational component focuses on evaluation of the 
effect of computer assisted instruction {CAI) upon student performance 
and behavior; assessment of the ^ impact of the CAT upoti instructors, 
administrators,* and the institution itself; and appraisal of the 
potential and qffect of the methods used to produce,- operate, and 
maintain the course materials. These cost, technical, and educational 
analyses identify strengths and' weaknesses of PLATO and TICCIT, and 
begin to assess the extent to which the promise of Instructional 
technology^ has been fulfilled. 

Anastasio,^ Ernest J*". Survey of Instructor Activities and Attitudes . Educa- 
tional Testing Service, Princeton, Nj, 1972, 18p, Not available separately, 
see ED 072 070 (84pO. ED 072 071." 

A survey questionnaire of the daily activities' and attitudes of 
instructoi:s participating in ^demonstrations of the University of 
Illinois and Mitre computer-assisted instruction (CAT) systems i» 
provided. The first section of the questionnaire concerns the 
instructor's background, present status, and teaching practices. 
The sftcond section asks for opinions regarding computers and CAl, 
atid the fit\al section focuses upon opinions regarding various 
educational practices that may be ii^fluenced by these projects. 
The questionnaire is comprised of a total of 83 questions. * (For 
related documents, see ED 072 O70,.072, and 119.) 
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Andersort^ Beverly L. Kodlak Island Borough School District -Title J V Pro- . 
ject. FjLnal Evaluation Report:, July 1977 > Kodiak Island Borough School' 
District, AK; Northwest Regional Educational, Lab, Portland, OR, 1977 ^ 133p. 
ED 142 359* ■ . ^ . " ^ 

Presenting a formative evaluation of ttie 1976-^1^7 Kodiak Island 
Borough School District Title IV Elementary Secondary Education Act 
Project involving 4 schools, 8 teachers, and 50 s,tiKients in grade* 
9 and 10, this program evaluation addresses a model based on a 
philosophy of individualized and independent instruction employirife 
^elf-pace<i and prepackagied curriculum materials, community resources, 
a learning manager approach to teaching, student open entry-open exit, 
and an overall management/ teacher support system. Data sources for 
this report include a 1976 evaluation report of^ the preservice teacher 
training workshop; a first quarter evaluation summary (December, 1976); 
a summary of rural secondary schools project coordinator's activities 
and time; "data frorft interviews with parents, students, school boSrd 
members, teachers and administrators; quarterly reports i^rom each of 
the schools; •teacher unit rating forms on each teaching unit used 
during the ye^; student unit rating forms on each unit studied 
during the year; school visit checklist summary; and the Iowa Test 
of Basic Skills (pre^ and post-tests). Structured according to 
evaluation questions devised in the August 1976 design, the evalu- 
ation results are presented in terms of answers to questions regard-- 
ing the overall program, materials, teaching methods, teacher train- 
ing, and the managerial system. 

^ ^/i" ^ 

Appel, Marilyn and others. Cognitive and Affective Outcome^ in Children as 
a- Function of Participation in SCIL^ an Individualized Version of the SCIS 
Program , Research for Better Schools, Inc., Philadelphia, PA* Paper pre- 
sented at the annual meeting of the American Edupational Research Associa- 
tion, Chicago, IL, Apr.il 1974. 20p^ ED 097 379, 

An overview and rationale for the Science Curriculum for Individualized 
Learning (SCIL) are provided, SCIL is the result of the individualiza- 
• tion of the SCIS progranj. The SCJL nianagetoent system is based on the 
exploration, invention, and discovery concepts of Piagetian theory. ^ 
An evalua,tion study of two SCIL units, including interactions, systems, 
subsystems, and variables, is presented. It was found that over 90 
percent of the SCIL students in grades 3-6 achieved cognitive goals as 
measured by completed discovery lessons. Students in the SCIL program 
chose ^moi^e positive responses when compared to students in teacher-made 
traditional curriculum. The SCIL students also chose more positive 
rei5ponses when compared with nonind Ivldualized program^s. Third grade 
SCIL students chose more positive responses than did SCIL students in 
grades 4, 5; and 6, suggesting that the units were well suited for the 
third grade students* develoftifental level . The parents o.f SCIL students 
chos^ highly positive responses when asked their perceptions of their 
children Irt' relation to SCIL and science activities. 
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Ardi, Dania B. New Avenuca of Teachings Resources—Sesame Street Proia { ;raas 
for the Mentally Retarded Child . " Paper presented at the. annual interna- 
^ tional convention. Council for Exceptional Children, Atlanta, GA, April 
11-15, 1977. 13p. ^ ED 139 197. 



The Sesame Street "Play to Grow" raaterialf , designted to foster a 
positive self-iaage in retarded children, were evaluated with 173 
mentally retarded (MR)' children (4 to 12 years old), 45 day care 
program children (mean age 4.3 years), and 45 second graders. 
During sample tape presentations, children's visual attention, 
verbal coaonents, and motoric behavior were recorded. Aaong findings 
were that attention of both MR and normal samples averaged from "high 
moderate" to "very at;tentive"; that MR children were more involved 
,^ with their viewing; that children's c6ra^ehension of "Play to Grow" 
segments was excellent ; and that although normal secohd graders were 
vqry awai;e of the differences in the way the MR children went about 
performing "Play to Grow" activities, bias and prejudice could not be 
detected. A list of the program's values and a sample segment outline 
are provided. ^ 

Bailak, Hilton M. an,d Castro, Barbra. A Second Year Evaluatjion of Individu- 
alized Prescribed Instruction (IPX) . Research for Better Schools , Inc . , 
Philadelphia, PA, 1969. 80p. ED 036 157, 

This evaluation report of IP! in its second year concentrates on three 
main points: student attitudes towards IPI, teacher and student class- 
room activity and interaction, and student achievement during the 
^hool year. An account of overall impressions concludes the report 
which does not Attempt to formalize any conclusions. It stresses, 
h^ever, the point that IPI is still in its infancy and has a long way 

go before it matches the model of individualization of instructioH 
'envisioned by its developers. So far it does not begin to do so; for 
the second year, measured achievement in IPI is less than that observed 
in non-IPI classes. If this turns out to be the finding in other areas 
where IPI is being tried out, further development might be .needed before 
the program could merit nationwide dissemination. 

• • • » 

Baker, Eva L. Practicum for Instructional' Developers. Final Report . 1975. 
73p. ED 098 266. 

The report describes the development of a project which produced an 
integrated set of 1 materials on formative evaluation that arp appropriate 
for use in graduate training, research and developmental settings, and 
public school personnel use. The objectives of the project were: (1) 
to identify relevant data sjources for formative evaluation and to out^ 
line a plan that Incorporated appropriate data sources; (2) to be able 
to display data from a variety of sources, to suxaaarize information in 
nonstatistical ways, and to draw inferences about program components 
that require revision; and (3) to suggest revisions of i^nstructional 
materials ^hen provided with a program description and an unanalyzed ' 
data set. Tlie materials were developed in the course of eight tryout 
and rjjpvision cycles and now meet the expectations of their designers. 
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Ball,^SBmuel and Bogatz^ Gerry Ann, Research on Sesame Street: Some Impll- 
catloiia for Coapensatory- Edtication . Educational Testing Service, Princeton, 
NJ, 1972. 30p. ED 068 155. | 

The first two years of Sesame Street were evaluated as to thfiir 
effectiveness as coxapensatory ^ucation- The evaluation assessed 
pi^ogress along soxae 36 prixaary goals of the show, as well as transfer 
effects, hoine 'background variables, parental attitudes, and socio- 
economic status factors. Over 1,300 preschool children were tested, 
and many were observed as they viewed the show* As Sesame Street was 
intended primarily for disadvantaged children at home who had received 
no educational jln t erven t ion, the major co^entration in the sampling 

^ was on that subpopulation. A content analysis was made of the show; 
a questionnaire was administered to teachers whoae clgj^^^es vi^«d the . 
show; and the amount of viewing for all subjects was- assessed using 
four assessment techniques, A follow-up study was carried out in the 
second year of the specific subpopulation of the first study. In 
addition, at-home disadvantaged children who had not viewed the show 
ips first year^were sampled. Resiflts of the evaluation indicated 
that: (1) maity tests of young children that are currently in use are 
not adequate; (2) among the subjects, there were no significant effects 
•due to race; (3) the show had a marked^ effect not only in the areas of 

- rote learning of basic skills but also in higher areas of cognitive 
activity, this ef fec|j^J)eing shown by both boys and girls; (4) amount 
of viewing was significant in gains made; (5) the disadvantaged - ' 
tended not to view as much; (6) viewing of Sesame Street affected 
scores on the PPVT administered as a posttest; ^nd (7) disadvantaged 
3-year-olds learned much of the material taught during the iirst 
year of the show. 



Ball, Samuel at>d Bogatz, Gerry Ann. Sesame Street Summative Research : 
Some Implications for Education aud Child Development . Educational 
Testing Service, Princeton, NJ. Pap^r prese^nted at th$ 79th annual ' 
convention of the Americfan Psychological Association, Washington, DC, 
September 7, 1971. 12p\ ED 057 914. 

In an effort to evaluate the effects of -Sesame Street, 943 3-, 4- 
and 5-year-olds, including disadvantaged children from the inner 
city, advantaged suburban children, children from rural areas, and 
disadvantaged Spanish-speaking children, were tested by adults from 
the children's own neighborhoods. Results indicated that: (1) the 
children who watched the most learned the most; 1^2) the skills that 
received the most tiise and attention on the program were, with some 
rare exceptions, the skills that were best learned; and (3)> the 
program did not require adult supervision for the children to learn. 
The children viewing at home showed gains as ^reat as, and sometimes 
greater than, children who watched at school supervised by th^ 
teacher. Various disadvantaged groups made as much progress as 
advantaged children in learning from television. Measuring techniques 
developed for the study proved especially valuable when combined with 
the services of coordinators and testers who lived in the communities 
being tested. 



110 

ii7 



B*ll, Sanuel and others. The First Year of Sesaae Street; An Evaluation . 
Final Report, Volvme III of V Volunies . Educational Testing Service, 
Princeton, NJ, 1971. 442p. ED 047 823. ' • " 

< This sfeudy evaluates the impact of \he first year of .Sesaaw Street 

. • on preschool televiewing audiences in five sites (Boston, MA', Durham, 

• ' , NC, Phoenix, AZ', Suburban Philadelphia, and northeastern California). 

Chapter I introduces evaluatipnal questions and the research s^riategy. 
Chapter II pre^fents sai^ling procedures for pretest and posttest data 
on 943 children, explains criteria for development and selection of 
measurement instruments assessing children's learning, program content, 
parent and teacher attitudes, and describes field operations. Chapter 
III analyzes results in three parts: (1) a descriptive analysis of 
the viewing population (age, sex, advantaged children, Spanish-speaking 
children, rural children, and disadvantaged at-home and in-school view- 
ers) ; (2) a probing analysis investigating in depth the characteristics 
of at-home, disadvantaged, high-viewing children in relation to home 
background and high or low learning; (3) an inferential analysis exam- 
ining the overall effectiveness of the television series in achieving 
its goals. Chapter IV presents the summary, concli^sions , and recom- 
'S; . mendations. Extensive appendices include detailed information on 

■ "Sesame Street" goals and evaluation instruments. 

\ ■•■ 

Ball, Samuel and others. Reading With Television; An Evaluation of the 
Electric Company. A Report to the Children's Television Workshop. Volumes 
1 and 2 . Children's Television Workshop, New York, NY; Educational Testing 
Service, Princeton, NJ, 1973. 200p. ED 073 178. 

An evaluation of the first year of The Electric Company is provided. 
Volume 1 is 'Comprised of the following chapters: I. Introduction'; 
II. Preparing for the Evaluation — Research Design and Sampling Pro- 
cedures; Field Operations-, The Treatment— The In-School Viewing Treat- 
ment, the At-Home Viewing Treatment, and the Content of The Eleetrio— 
Company; Measuring Instruments—General Considerations, Tests for 
Children, Parent Questionnaires, Teacher Questionnaires, Observations 
of the Classroom, Attendance Records, Viewing Records, and Content 
Analysis; III. Results— The Questions to-be Asked; Descriptions of 
the Sample; Analyses of the In-School Viewing Experiments; and Analyses 
of 'the At-Home Viewing Experiments; and IV. Summary and Conclusions — 
Summary of Project Activities; Summary of Results; Conclusions; and 
Future Research. Appendices present: Goals of The Electric Company; 
Description of the Electric Battery and Sample Items; Pretest Teacher 
Questionnaire; Posttest Teacher Questionnaire; Observation Form; 
Viewing Record; and Content Analysis. Seven abstracts are provided 
' of the six viewing experiments and of the overview of significance 
levels of tests and subtests for the In-school experiments in Fresno 
and Youngstown. Volume 2 consists of 57 tables which provide the 
study data. " 
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B«il, Samuel and others. Reading With Television: A Follow-Up EvaJ-uation 
of the Electric Company . Children's Television Workshop, New York, NYj 
Educational Testing Service, I^rinceton, NJ, 197^. 348p. ED 122 798. 

The second-year evaluation of The Electric Company Children's Televi- 
- sionyseries used reading tests to assess the skills apd concepts 
addresfsed on the show. Tests were given in October and May, and 
teacher questiopnaires were administered three times during t|?e 
second year. Classroom atmosphere- during the viewing time was 
% : observed* as well. The positive impact of The Electric Company on 
reading skills and student attitudes was as favorable in the second 
year as in the first, though the size of the impact in the second 
year was less. On^ year's viewing seemed to provide the major bene- 
fits for students. No particular teacher attitudes or behaviors \ 
were consistently found to have a relationship with student reading 
skill gains as measured by this evaluation. A summary of the first- 
year evaluation is appended. , 



Banathy, Bela and others. The Analysis and Reporting of Evaluation 
Training Materials Developed by R&D Laboratories and Centers. Final Repott . 
Far West Laboratory for Educational Research and Development , San Francisco, 
' CA, 1976- 71p. ED 150 166. 

Evaluation training materials developed by federally funded research 
and development laboratories were surveyed, analyzed, and 'described. 
This project included the collection and analysis of training materials, 
and the development of the Consumer's Guide to Evaluation Training 
Materials. This final report describes the .rationale, purpose, and 
activities of the project, aijd the Consumer'^ Guide, and includes, a 
satmple of the product descriptions included in the guide, ''The analy- 
si3 of the .evaluation training products and a description of the 
relationships between these products are also discussed. A list of 
titles evaluated in the guide, an index to these training materials, 
and an analysis of the training materials produced by each research 
and development laboratory are appended. 



Banks, Henry A. Evaluation of an Instrijct lorial Program in Traini ng Teachers 
to A nalyze Educational Materials for Possible Racial Bias , Paper presented 

at the annual meeting of the -American Educational Research Association, 
Chicago, IL, April, 1974. 31p. ED 090 307. 

Content analysis of textbooks for black students in grades 1-3, a pro- 
gram for teachers of the first- through third-grades, was developed by 
the Far West Laboratory. The*overall objective of the course was to 
develop teachers' skills in analyzing textbooks in terms of their 
appropriateness for black pupils. ''Data collected during an operational 
field test revealed that the course is effective in (1) increasing 
teach^^rs' awareness of the need, to analyze textbooks, and (2) bringing 
about an improvement in their abiltCy to perform the analysis. 
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Barry, Roger D. and Carter, Robert A. Evaluation _of Qeaer^l Chemistry 
Slidg/Audio-Tape Prosraas . Northern Michigan University, Marquette. 
Institutional^ Research Office, 1972, lOp. ED 066 124. 

This document presents an evaluatioit of an instructional system to 
assist students in- the general chemistry course* Thesis materials 
include a series of 16nm sound motion picture films that outline 
the required laboratory experiments, slide/ tape programs for individ- 
ual student use designed to teach the student how to analyze and draw 
conclusions from the laboratory data for each experiment similar 
slide/ tape pirograms covering many of the lecture topics, and an 
instructional booklet that contains sets of problems and learning 
exercises related to lecture topics and an outline of each laboratory 
experiment. Four major points can be cited as a result of the evatlu- 
ation study: (1) the achievement of students who use the slide/tape 
programs was superior to the achievement of those who chose- not to 
use than; (2) for those students who \xsed the materials, achievement 
tended to increase slightly as the amotint of time devoted to the 
slide/tape programs increased; (3) a slightly higher proportion of 
low than high ability students chose to use the slide/ tape materials; 
^nd (4) lower ability students who chose to use the materials tended 
to spend slightly more time on them than^did high ability students. / 

Bartholomew, Robert and Keyer, Bonnie. Developing and Evaluatinj^ Learning ^ 
Devices for Exceptional Children . Tompkins-Seneca-Tioga Board of Coopera- 
tive Education^^ Services, Ithaca, NY, 1977, 23p. ED 132 779. 

A research project was conducted to develop and evaluate learning 
products that 'would assist exceptionai children in learning specific 
skills. To investigate the learning processes of exceptional chil- 
dren, data were gathered from site visits, interviews, observations, 
relevant literature, copies /)f curriculimi and evalixation fotTas for 
Exceptional children, and inquiries to 43 toy and educational equip- 
ment manufacturers. Differences in"- learning prbcesises between normal 
and exceptional children were examined, and various skill develop;nent 
areas were outlined. A list of desired product attributes (such as 
simplicity and ease of manifSulation) were drawn up as MLinitial step 
in product development. Five of the learning devices developed (the 
visual discrimination puzzle, perceptual developme^it cards, body parts 
puzzle, number puzzle, and measuring device) were tested with 17 
children (^-13 years old) attending primary and intermediate classes 
for the trainaSl^^ mentally retarded. Results indicated that use of 
each of the learning devices increases Ss ability to perform on these 
devices as^well as to apply the skills and concepts to similar, more 
^practical situations. In addition, performance Improvement was main- 
tained over time without further contact with four of the five devices 
(some forgetting over time did occur with the measuring device). 
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Bennic, Prances. Pupil Attitudes toward Individually Prescribed Lab Pro- 
grams, Journal ,of Reading , vl7, n2, plOS-12. Nov 1973. EJ 085 878. 

Assesses a learning lab program while ineasuring student's attitudes 
' toward individually prescribed reading instruction through a 10^ 
item questionnaire. 




Beyer, Barry K. and others. Evaluation of Africa South of the Sahara. An 
Inquiry Program for Grades 7-10 > Carnegie-Mellon University, Pittsburgh, 
PA, Project Africa, „ 1969. 139p. ED 038 545. < 

Project Africa, a social studies curriculum research and development 
• project, is primarily engaged in testing new materials and techniques 
for teaching about Africa south of the Sahara in American secondary 
schools. The purpose of this technical rep,ort is to highlight the 
program's strengths and weaknesses from a variety of viewpoints— 
those of scholars, teachers, and students. Evaluation data were 
collected by a variety of instruments and procedures for use in 
designing new materials and techniques for teaching about Africa. 
, The document should be used as a working ^per with cons tai>t reference 
to the instructional materials and teaching guides, the project mate- 
rials are now available to interested educators to refine further and 
to adapt to the specific needs, interests, and abilities of their own 
particular students. 

Blackburn, Susan Fleming. The Construction, the Implementation, and the 
Evaluation of a Title I Primary Grade Listening PrOigram . Ph.D. Disserta- 
tion, The University of Mississippi, 1977. Available from University ; 
Microfilms, P. 0. Box 1764, Ann Arbor, MI 48106 (Order No. 76-20-519). 
167p. Eb 127 626.* 

The purpose of this study was to determine the effect of a structured' 
listening program on 220 first-, second-, and third-grade students 
enrolled in Title I schools in Albuquerque, NM", public school system. 
All of the students were given the Educational Testing Services' 
Cooperative Primary Tests: Listening, and the author's own Listening 
Rating Scale'. Half of the^-subj ects then . received .one 15-minute 
listening lesson daily for a period Of "20 days. Analysis of post- 
tests revealed that the improvement in listening ability of the over- 
aU experimental group was slgn'if icantly superior to the listening 
ability of the overall control group, as measured by both instruments. 
However, no significant- improvement was noted in listening ability for 
the second-grade group, the third-grade group, or for first-through- 
third-grade girls, as measured by the standardized test alone. 

Bramble, William J- and others. On the Beam; The Appalachian Education 
Satellite Project, Appalachia , " v9 , n5, pll-17 ,^ "April-May 1976. EJ 139 835. 

Preliminary evaluation of^^-year's op*fation indicates the Appalachian 
Dj jc - ^ «i 1 < ♦- PT•rt^Q^^ ^ c nrn-ir-f Air,& fifl iif f/f r»n roursps t(T teachers 
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reliminary evaluation or a^year s o^«TaLJnjii iiiuj.v-«i.c& .-nc ri^j^A.av.iix«vi 
ducation Satellite Project is providing education courses t<f teachers 
t a reasonable cost, and 'I'M proving that sUch an operation is feasible 
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Bramble, William J. and others. Performance of AESP Transmissiorr/Rec^ptlon 
Equipment;. Sumer and Fall^ 1974^ Technical Report 5 ^ Appalachian 
Education Satellite Project, L|^ington, KY, 1975. 63p. ED 114 Oi53, - 

The Appalachian Education Satellite project (AESP), using the ATS-6 
Satellite, has designed a variety of Txmlti-media learning *%ctivities 
intended to upgrade ti;ie quality of instruction in ^Appalachia. Four 
nsodes of conmunication (televised programs, four-channel audio review, 
four^channel data, collection apd ax\alysis, and VHF--teletype relay 
system) were eaclK evaluated according to the following criteria: 
uses, equipment requirements, organizational requirements, and the 
^_V^ quality of comnainication. This is the fifth of ^12 volumes in the 
^''^ technical report series on AESP. • ^ \ 

.. . 

Branson, Robert K. / Formative Evaluation 'procedures Used in Designing a 
Mu 1 1 i-^Me d Ja Phy s ic s . Co ur s e « Paper presented at the annu^ meeting of the 
American Eaucat'ional Resea'tch Association, New York, NY, February 1971, 
20p. ED 05O^ 140. • ^ 

This research, conducted- at the U. S. Naval Academy as parr of a 
total effort to design a xnulti-media physics course, collected data 
on the learning materials used in Fall 1969, investigated the tech- 
nical characteristics of the' criterion-referenced test items used, 
and studied student preferences for the alternative study approaches. 
The ultimate intention was to develop an effective and efficient 
physics course which could be readily modified by the various course 
instructors. Seven alternative teaching/learning approajches were 
developed, based ^on objectives derived from four widely used physics ' 
textbooks. -These approaches included two forms of lectures, a stj^y 
guide, videotapes, and other audiovisual aids. Results demonstrated 
that the method of instruction was not, the critical elenlefit in 
student performance, that students could achieve good results on 
their own if provided with the necessary instruction and materials, 
and that if data are collected systematically and u6ed to revise 
course components, considerable improvements can be made at each 
iteration. 



Bravo, Anne. , An Evaluation of the Urban Education Program ^*Multi-Sensory 
Stations Program J' District 10, New York City Board of Education ^ Ford- 
ham .University, Bronx, NY, Institute for Research and Evaluation, 1972^' 
12p. ED 059 024. 

The objectives of this. program were to provide reading remediation 
and curriculum enrichment through the use of audiovisual resources ^ 
and to train teachers in using new Instructional media and developing 
new instructional techniques * The program was coordinated by a f ull-- 
time teacher with the help of one paraprof essional assistant in each 
participating school, Mobfle carts- housing different equipment and 
materials were moved by the assistants from one classroom to another 
to provide individual, small group, and whole-group instruction. The 
target pupils were those evaluated to be below gr^ide levels Evalu- 
ation was done through interviews, questionnaires, observations, and 
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'anAl^sis of test results for^^an eappiexisiental group froci four schools 
-anjj^; control group frow six schools* The following findings were, / 
obtained: (1) the majority of children who particl^pated in the pro-" 
gram liked it, (2) there w^s a need for better cotmimnica^ion with, the/ 
- children as t6 the method^ and goals of the l^ssdnst (3) the general 
perfonnajice was significantly lower in cojaprehension than in word 
recognition, (4) the experimental group raide .slgnif icahtly greater . 
gains over- the control group (P<*01) on the Me ttopolits^ti Reading 
Achievement Test , and (5) teachers had. mixed reactions to the program-- 
the major> problem identified was the relationship between teachers j^hd 
the paraprofessipnal assistants* Recommendation?' were, mad^ for. improve- 
ment and continuation of the pi^ogram.^ 

" ■ *■ . ■ * 

Brlckner, Ann and Sehter, ^Donald R. Follow-up. Study of 4^ISTEN LOOK LEARN ^ 
First Year Students Who Used Traditional Basal Pyogratiig^ in^Second Year > 
Educational Developmental Laboratories, Inc,.^ Huntington, NY, 1971^;. i3p* 

For those school distric^ts who wished an evaluation of the LISTEN" 
LOOK LEARN (LLL) System at grade 1 before ^^p^l,nding it into higher - 
grades, a small study was conducted to, dfet ermine what effect the 
transition to a basal reader wpuld have on this child taught beginning • 
reading' in the LLl progrstei. Two school districts' submitted endrof-^^ 
first-grade Metropolitan Achievement Teste data and end-<>f^sec&nd-* 
grade Stanford Achievement Tests (SAT) data for five classes of 
children who were taught reading by the LLL m^pt hods and iSfechniqueis . - i 
in grade 1 and ^ basal re^d^ng program in graiie 2- . For H>pth districts 
the means "for SAT word raeanihg and paragraph meaning wer^ sdteiewhat 
above the national norms, A third distxiet used the LLL sy&tei» in a 
^ corrective and remedial^periment ' classrooia with third-'graiie children*^ 
At the end; of ^he third grj^de, 35 children took HoughtQn Mifflin" ^ 
Achievement Tests. For more than 90 percent, of 18 possible sc6res, 
the children scored at or above the critical score (80 perc^t olr. 
above), thus showing they were ready to re-enter any fourth-^gj:§de ; 
classroom, and read on or above grade level. Reports .^f two lijrge- 
scale comparative research projects of LLL and basal programs may be 
• found in ED 049 019 and ED 027 l66. Graphs and^^bles are included. 

Brickner/Ann and others.- Summative Evaluation of LISTEN LOOK LEARN 2n4 
Year S tudents, Cycles 1968-69 / Educational , Development tl Laboratories , 

Tnc, Huntington, NY, 1970. 48p. ED 049 016. 

This study represents the second segment of the S-year longitudinal 
study to test the effectiveness of the LISTEN LOOK LEARN (LLL) multi- 
media communication skills system. Data were analyzed for the 1968-69 
school year for 159 students who participated in LLL itistruction during 
both their first and second year, 113 second-year . students who used a 
traditional reading program during their first year, and 240 control 
students who had two years of. reading instruction in a traditional 
prograni. The data ^re collected by questionnaires completed by teach- 
ers and by standardized tests. The subjective evaluation of the teach- 
ers showed that 11 of the 12 cooperating teachers enjoyed using LLL, 
nine of the 12 believed it to be superior to other programs with which . 
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.they had^had experience, and a difference Of (pinion aatijitfed as to 
■^^^^^^^ ;'t^^^^ level vrith which LLL was aost effective. Analysis pf 

,^ th^ btijecti^^ that the LLL studeats score4 significantly 

, above control students on the word meaning, paragraph meaning, and 
: wpci^d s.tHdy of the Stanford^ Achievement Test and at a 

^> ; . a^^ abpye control studeats on the Cooperative Primary 

Tests,' List (fining , , Tables are includ^. 

Brightman, Richard W. Computer Assisted Instruction Program for Police 
Tralninj>^ Coastv.gpftaunitv Cbllege District, Costa Mesa, CAj Los Angeles 
Police Depar43&feiij6i' C^;:^ 63p. AvaUable from Superintendent of 

Oqcryments, U. "S . Government Printing Office, Washington, DC, 20402 (N-2700- 

QO^r^.r:Ei):0(^ 858. '\ ' 

A project tiras diEivtsed to develop study materials for a computer- 
ass^^ instruction (CAI) course In* police training, to dev.elop 
cotapuferized pase problems, and t^f^aluate the effectiveness of the , 
learning mater ials as compared with conventional classroom instfuc- 
^ tidn in the sanie ^ubject areas. Both an experimental group (police 
cadet&-a;-c the Golden West Police Academy -who studied the course 
■mat^rial^ tKirough use of a syllabus and CAI) and . a control group 
(pojifcecadets ■it Los Angeles Police Academy who studied the same ^ 
subject throiigh convention^tl classroom instruction) took intelligence 
tests and personnel t^^e^ of these tests allowed 23 matched 

-paltst from conta?cfl and experimental groups to be formed. At the con- 
clusibh of the training program, a-ll subjects completed a written 
examinatixhi.' Results of analyses of performance scores on the eScam- 
ination showed that the experimental group performed significantly 
better than the control group. Apparently, CAI and' independent 
stMdy are fekfective techniques for police training and should be 
Invefiitigated .further and expanded . 

Brown, Edward K. . T^e Nongraded Program at the Powell Elementary School : 

fevaluatiop Phase 11 . Philadelphia School District, PA, 1970, 39p. 

ED; 049 29.8, - 

Nongraded programs attempt to individualize instruction through the 
^ systematic assignment and reassignment of the pupil to classes con- j 
. sist^nt with his performance level. This evaluation of the nongraded / 
program at Powell Elementary School (grades 1-6) indicated that ' 
inidividualization of instruction did 6ccur at Powell and that the 
pupils* performance in reading and aritlmietic or\ the Iowa Test of ' 
Basic Skills was significantly improved over the previous year. In 
addition, nongraded pupils attained higher levels of independent 
study skills than most of their peers in graded schools. Instructional , 
modifications suggested for Implementation at Powell include upgrading 
program offerings and materials for the upper-level pupils, reassigning- 
pupils on a more frequent basts, and Increasing intra-teacher confer- 
fences. To provide greater program effectiveness, additional inservice 
training and preparatory periodi', supplies, and secretarial services 
are recommended. An administrative-roster' chairman and a full-time 
instructional materials center assistant are additional enabling 
recommendations. 
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Buffer, Jamea J. and others., A Junior High School Industrial Technology 
Curriculum Project: A Final Evaluation of the Industrial Arts Curriculum 
Project' (lACP), 1965-1971 . Ohio State University, Columbus, Research 
Foundation, 1971. 395p. ED 054 389* ! 

The objective of the Industrial Arts -Curriculum Project (lACP) was 
to develop, refine, and institutionalize a new and releva^nt two-year 
junior high industrial arts progra^a. The study focusi^ on •^Industrial 
Technology,** the knowledge of management, production, and personnel 
practices used by men to produce goo^ to ^tisfy their needs through : 
construction and manufacturing activities. As a result of a six**year 
program of intensive research and develoiment, field testing, evalu- 
» atiof^, and revisions, two one-yeax courses were developed. These 
courses ire entitled **The World of Construction" and "TherWprld of 
Manufacturing.** The instructional packages for each include textbooks 
laboratory manuals , teacher ' s guides, achievem^tnt tests, related hard- 
ware, and audiovisual materials* The materials were field^tested ovec 
a four-year period with 20,000 students is 13 states and were coordi- 
nated through 124 headquarters and field staff' members. Workshops have 
been conducted in 45 colleges and universities for preparing teachers 
to adopt or adapt the lACP syston. The instructional packages are \ 
available through McKnight and McKnight Publishing Co., Bloomington, 
I^, and are adaptable to existi]|g indiistrial arts facilities » 

Bunger, Marianne. Two American Studies on Literacy through Television: 
Operation Alphabet In Florida, Literacy Discussion , vl, n3, pl29--42. 
Suimaer 1970. EJ 028 470. 

A statewide concentrated literacy campaign using Operation Alphabet 
Telecasts was launched in Florida, in 1963. This article relates the 
history of the campaign, describes Operation Alphabet, and evaluates 
sojtie of the instructional procedures used. 



Caldwell, Kathryn S. The Veterans Administration Experiments in Health 
Cottwmni cat Ions on the Applications Technology -Satellite (ATS-6) . FJlnal 
Report , Applied Communication Research, Stanford, CA; FouAdation for 
Applied Communications Technology, Los Angeles, CA, 1976. 68p , ED 119 719.. 

Because many of the Veterans Admiuistration hospitals in Appalachia 
are located great distances from medical teaching facilities, high 
powered communication satellites have been emplaned to facilitate 
quality two-way communication between medical personnel scattered 
throughout the region. To achieve diagnostic, therapeutic, and 
educational purposes, the National Aeronautics and Space Admlnistra- 
tions^S (NASA) Applications Technology-6 satellite was field-tested 
in five different modes: (1) video seminars, (2) teleconsultations , 
(3) grand rounds, (4) out-^patient clinics, and (5) computer -mediated 
events. All five modes provided clear communication and significantly 
altered the climate of the 10 hospitals involved in the experiment* 
The video seminars were particularly well received. Details of the 
program evaluation are provided. - - ^ 
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Caldwell, Robert M/ Literacy Developaient: Ufring a Progyaaaed Text and 
•Computer Aaststed Inatruction . Papef 4>resented at the annual meeting of 

the American Educational Research Association, Chicago, April 15-19, 1974. 
~23p. ED 089 216. 

The piirposes of this study were to evaluate the effectiveness of a 
literacy developmetlt prograo using the computer as a means of adjust- 
ing reading instruction to the varying abilities of illiterate and 
^semi-literate adolescents and adults, and to coapare the effective- 
ness of the literacy materials presented through the conputeif system ' 
with the effects achieved by identical materials presented through a 
programed text. Subjects used in this investigation were enlisted 
. from five high schools iif^^centre County, PA; they ranged from 14- to 
IS-years-old -and read be^^fifth grade level. Some of the findings 
were that reading ma teriifLs sequenced for instruction ip both the 
programed text and a computer-based display unit were successful in 
producing significant differences between pretest and posttest 
achievement; the programed text and the computer-based display unit 
were 'equally effective; further study needs to be made into the 
effect of mechanical problems encountered in the use of computer" 
systems as they influence! student achie-i^ement; students using the 
computer-assisted^ reading materials Vere more positive in their 
attitudes toward that mediiim than students using the programed text; , 
and students using the computer system spent an average of 18 minutes 
longer at the instructional task than those using the programed text. 

Carpenter, C. R. and others. Educational and Instructional Television 
Facilities Evaluation; Preliminary Practical Procedures . Pennsylvania 
. State University, University Park, Department of Psychology, 1968. 86p. 
ED 037 101. . ^ 

Leaning^ heavily on national educational television affiliates for its 
information, this survey of instructional television production units 
and the relationship of their facilities to the quality of television 
courses which they produce, found that instructional television was 
fairly well off in terms of hardware and only slichtly lacking in more 
highly trained personnel; the future, however, with its inevitable 
expansion of need for more and more instruction via television, did 
not hold a happy prospect. (ED 037 099, -^lOO, and 102 are related 
documents.) 

Chltayat, Linda. An Evaluation of Computer-Manased Education Technology at 
New York City Cotgnunlty Collese . ' City University of New York, Institute for 
Research and Development in Occupational Education, 1976. 51p. ED 144 524. 

The Comput ex-Managed Education Technology (COMET) program was designed 
to improve group instruction through the use of "technological aids In 
the classroom. Specific objectives included (1) improving feedback on 
student comprehension during a class period,, (2) facilitating the 
administration and grading of homework and quizzes, (3) providing for 
the use of multimedia equipment, and (4) providing effective methods 
for student self-study for remedial purposes. Two classrooms* and 
supplementary facilities were equipped with a sttfl^nt response system 
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(SRS), five audiovisual response (AVIt) atatioas, multiaedia eqtiip- 
aent, a mi)aico#uteir (NOVA 840) , aad a card reader , and line printer 
. for inputting data and retrieval of print-liuts. from the coj^uter. 
The courses taught using the COMET facilities were mostly technical 
or skills oriented and primarily involved lower classmen in intro- 
ductory or developmental claases. Siicteen instnsctors and six 
classes w«re administered questionnaires designed to meiasure (1) 
degree of program implementation; C2) accuracy, speed, and ease of 
use of various hardware and software components; and (3) teacher and . 
student reactions ^o the program. The SRS was found to be a valuable 
instructional aid; however, the AVR stations, nmltiaedia equipiaent, 
and cQB^uterized capabilities of the program received little usage. 
Questionnaires are appended. 

Clarke, Wentworth. A Research Note on Simulation in the Social Studies, 
Simulation and Games , vl, n2, p203-10. Jun 1970. EJ 035. 774. 

■ f 

The use of a game simulating a political convention was found to 
improve both students' and parents' attitudes toward social studies. 

> • ... 

Clausiag, Gerhard and others. Individualized German Instyruction at the 
College Level: A Follow-up Report / Foreign Lan^age AnnaljS , v7, n2» 
p237-42. Dec 1973. EJ 088 050- 

Evaluates student achievement in second year individualized language 
programs at the University of California at Berkeley and contrasts 
data with results of student achievement in basic courses.' 

1 

Collet, Leverne S. and others. Formative and Suiaroatlve Evaluation of the « 
FEHR-Practicum Training Module. Final Report , 1975. 303p. ED 131 055. 

The purpose of this project was to evaluate the FEHR (Formative 
Evaluation and Heuristic Research) practicum training model, a 
computerized simulation pt'ovlding practical experience in decision^ 
oriented educational research and evaluation^ The repott is orgse 
nized into five chapters. Chapter 1 contains an introductory discus- 
sion of the »needs and purposes served, .a description of a practicum 
sessl'on, and specifications for each of the physical components of 
the system. Chapter 2 contains a description of the computer program 
which generates FEHR practicum data, and presents evidence of its 
portability and adaptibility . Chapter 3 describes the evolution of 
the present set of simulation problems and provides evidence of the 
• internal validity of each problem. Chapter 4 presents the results 
oS the empirical evaluation of the FEHR practicum system in a variety 
of instructional roles. The fifth and final chapter provides a 
summary of the evidence regarding the system's effectiveness and dis- 
cusses the implications for its dissemination and use. The findings 
provide evidence that, correctly used, the FEHR system can be useful 
In teaching research/evaluation skills. Its flexible form has proven 
quite effective for creative instructors who 'are willing to adapt 
their methods to the problem-solving mode that is most compatible 
with the FEHR system. The definitive finding of the evaluation was 
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that FEHR projects are mo»t ef fectivie when thtey ate an integral 

part of a training curriculum teaching research/ evalu^atipn techniquea 

and principles in a problem-solving discovery mode. 

Computer Aided Learning Project; Report, Trial 3 > London Borough, of 
Havering (England), 1973/ 36p. ED 129 281. 

In a third study of the C<»aputer Aided Learning (CAL) ayste^m of the 
London Borough ^of Havering^ the performance of students taught biology 
by a teacher using the CAL system was cotapared with that of students 
taught by the same teacher without the CAL system. Students were 
-divided into two matched groups and coaparaJ usln^ a pretest/posttest 
design. Students of ai;L ability levels who used CAL. appeared to gain 

higher score on the posttest than equivalent students taught by con-- 
ventional methods. About 75 percent of the students tlK>ught the CAL 
method was a satisfactory way to learn. 

Conger, D. Stuart, Coflg^ , and others. Evaluations of Life Skills Training . 
Training Research and development Station, Prince Albert (Saskatchewan), 
1974.. 173p, Available frony Information Canada, Box 1565, ^Prince Albert, 
Saskatchewan, Canada. '"ED 108 034. * 

Life skills are problenj^olving behaviors applied appropriately and; 
respontibly in the manag^ent of one's life. ' The purpose of this book 
is to make available eva^^tion reports on the use of the life skills 
course conducted by a Variilty of organizations^ Each evaluation 
study was bap^ed on a diffarej^^^ experimental design and in some cases 
the evaluation was done b/v th^i^ipplementer . The evaluation report on 
the course conducted by Mental ^alth/ Alberta represents one of the 
tuost thorough psychometric evaluations of a life skills course to date. 
The reports in this book indicate some of the variety of applications 
being made of the life skills course: mental health, probation, and 
housing. Since the purpose of evaluation is to provide information to 
decision makers whether they be potential adopters, adapters, or devel- 
opers, it is appropriate that this book on life skills evaluation 
should include a plan for. re-developing the life course. 



Cratty, Bryant J. and Szczepanik, Sister Mark. The Effects of a Program of 
Learni n g Games upon Selected Academic Abilities in Children with Learning 
Difficulties, 1970-1971 , California University, Los Angeles, 1971, 87p. 
ED 057 119. 

First graders (105 males and 152 females) from 16 central city schools 
within the Catholic Archdiocese of Los Angeles were selected because 
they were diagnosed as poorly prepared for regular classroom activities 
Following the adjnlnistration of a 6-'category test battery, the children 
were placed within two groups: Group 1, containing 84 children, was 
exposed during the first half of the school year to one-half hour 
daily enrichment classes composed of learning games intended to improve 
the academic operations previously evaluated; group 2, with 73 children 
remained within the regular classroom environment during the first half 
of the year. Following a second . test ing using the 6-category battery. 
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the children in group 2 were exposed to the daily program of learning 
gaae enriclwent, while group 1 r e m ain ed in the claas room* Thes learn-- 
tog gaffies, in general, are activities which require an active response 
- on the part pf the child and the content of the enrichment program was 
unique fo each school and flexible. Analysis of the data ifavolved 
intra-group correlations of the test scores, inter-group 'Comparisons 
of rates of change, and other similar procedures. 

^- • ' 

Culp, George, Computer-Assisted Instruction in Undergraduate Organic 
Chemistry: Design > Application^ and Evaluation. Technical Rfeport 10 . 
Tejtas University, Austin, Computer-Assisted Instruction Laboratory, 1971, 
lip. ED 072 630. \ 

The Computer-Assisted Ijistruction (CAX) program in undfergraduate4 
organic chemistry at the University of Texas was evaluated by an V 
experimental design in 1969 and found to be successful. This report 
discusses in detail the formation of the design, its application, and 
the method of evaluation. The program itself included 15 teaching 
modules that dealt with a variety of organic chemistry topics. 

• / • 

Cusano, Bernard. Children Learn to Read through Cooperative Teaching of 
Paraprofesslonals and Teachers > New York City Board of Education, Brooklyn, 
NY, Office of Educational Evaluation, 1976. 17p. ED 142 626. , 

This report evaluated a co"operative teaching program designed to 
provide supplementary diagnostic and prescriptive reading instruc- 
tional services to New York City elementary school students who were 
more than one grade level behind; in reading. Three hundred sti^dents 
in grades three ^through six, received reading instruction in reading 
laboratories. Specific skill needs were identified and an individual- 
ized program of reading instruction was devised for each student. 
Students were tested on e pre and post basis. Paraprofesslonals were 
rated for performance, and teachers were interviewed. This report 
concluded that posttest reading scores of students increased signifi- 
cantly over the anticipated post test scores. Paraprofesslonals per- 
ceived their program experiences as contributing toward improved 
performance. Interview data reflected positive reactions to the 
programs on the part of classroom teachers, paraprofesslonals, and 
students- The reading and language rating scale used in the program 
i'S included in the appendix, 

Dallman, Brian E. and others. Evaluation of PLATO IV in Vehicle Maintenance 
T raining , Air Force Human Resources Laboratory, Lowry AFB, Colorado Techni- 
cal Training Division, 1977. 146p, ED 153 638. 

The implementation and subsequent evaluation of the PLATO IV system 
in an Air Force vehicular maintenance training program are described. 
Outcomes of this project, which was designed to test the effectiveness 
of the PLATO IV instructional system in a technical training environ- 
ment, indicate that PLATO could be successfully incorporated into the 
technical training process, and that its training effectiveness, 
impact on attitudes, reliability, and utility are acceptable. The 
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only major drawback found, was the relatively high cost of ^PLATO aa ^ 
' compared with costs for other forms of training for similar applica- 
tions. Appendices contain survey forms and course development plans 
used in this project. 

Delhi, Ned and Zeigler, Ray H. Evaluation of Computer-Assisted Instruc- 
tion in - Instrumental Musicianship. Final Report . Pennsylvania State Univer 
sity. University Park, 1972, 46p. ED 067 897; 

« 

A project was devised to. eattend the applicability of a previously 
developed computer-assisted instruction CCAI) course in instrumental"" 
musicianship (see ED 035 33f4) , and to asses it« effects through the 
development and implementation of criterion referenced measures. 
Twenty-five injtermediate level students of treble clef wind instru- 
ments participated^ as subjects in the evaluation phase of the proj- 
ect. All students were given a listening pretest involving aural 
and aural-visual discrimination and a performance pretest; attended 
a CAI lab twice Veekly which included online listening and coordinated 
offline practice; and completed post tests which were the same measures 
administered previously as pretests. Group gains in bo*h listening ^ 
and performance were significant and dramatic; since the students had 
been playing these instruments for five or vnove years ^ it is presuxs^d 
that the results can be attributed to the experimental treatment even 
without comparison with a control group. 

Determining the Effects of "Developing Readiness for Pre-School Children 
via Television''; A Title III Project . Lake Central School Corporation, 
St. John, IN, 1973. 119p. E£) 093 484. 

This r^ort attempts to measure the first year effects of a local 
television series designed to increase reading readiness. Kindergarten 
children enrolled in the Lake Central Schools were subjects for testing 
the effectiveness of the TV readiness program. Other evaluation inputs 
included kindergarten teacher rater judgments and a survey of Lake 
Central School Corporation parents in the viewing area of channel 50. 
Data were collected and analyzed to provide an evaluation of (1) the * 
overall effectiveness of the approach as measured by results upon 
. kindergarten children, (2) the specific effects upon children by 
pupil types (l.el, sex, socio-economic status, and I.Q.), (3) the 
apparent quality of each of the 48 films to develop readiness skills, 
(4) the apparent receptivity of parents of young children in the 
channel 50 viewing area to the project, and (5) the basis for needed 
^ changes and revisions to improve the effectiveness of the project 
during Its development period. Rating scales, test results, and a 
complete analysis of evaluation material are Included In the appendices 
which comprise most of this document. 
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Devi tt/ Joseph J. Do Federally Fimdeil Prograas Really Work? The State 
Vlev> School. Media Quayterly vl. n4. p288-9Q« Sua»er 1973. EJ 078 922* 



The Waterville, ME, High School Media Center, an ESEA Titl^ III 
project, was studied to detenaine the effect it had had on Main^ 
schools. Questionnaires were sent to superintendents arid state 
librarians. This article reports the results. 

' ■ •■' ^ • ' 

Dickerson, I.arry R. and Roberts, Ralph, R., Jr. The Effectiveness of Pre- 
packaged Instructions for the I nservice Training of Reha'bilitation- Counselors. 
Counselor Education and Supervision vl4. n2, pl33-39. .Dec 1374. EJ 108 966. 

The results suggest that a voluntary packaged instructional approach 
to the conceptual training of rehabilitation counselors app^rs 
promising, but greater effort is needed in developing the training 
materials if thd program is to be effective. 

Dougherty^ Knowies and Herbert, Martin, Evaluation Report Final 
Suitmary RepotK:> Year 2 . Central Midwestern Regional Educational Labora-- 
tory. Inc., St.yLouis, MO, 1975, 35p. ' ED 142 439. 

The Comprehensive School Mathematics Program (CSMP) is a program of ; 
Cemrel, Inc., one of the National Educational Laboratories, and is 
funded by the National Institute of Education. Its major purpose is 
the development of curriculum materials in mathexaatics for grades 
K-6. Beginning in September, 1973, CSMP began an extended pilot 
trial of its elementary program, >the Comprehensive School Mathematics 
Program.' This report is an attempt to summarize the information col- 
lected during. the second year, 1974-75, when 30 school districts were 
irwolved In the use of some cc^qlii«ation of kindergarten, first, and 
setond grade materials. The report includes data on the school sites, 
review of formal written reports, and a review of evaluation questions. 

ir 

Doyle, Charles P'. and Fenton, Dorothy. Teacher Involvement as Correlated to 
Degree of Acceptance of In-service Television Programs. Illinois Schod'l 
Research v8, nl, p53-6. Feb 1971. EJ 051 764. 

Dunn, Alex, Ed. , and others. Computer^Assi^ted Instruction Program. A / 
Three Y ear Report Covering July 1, 1971 through Jupe 30, 1974 . Montgomery 
County Public Schools, Rockville, MD, 1974. 203p . ED 100 361. 

The Montgdmery County Public Schools Computer Assisted Instruction 
(CAT) program, which began in 1968, was federally fi^nded for its 
first three years; since 1971, its activities have been supported 
through locals funds and an outside grant covering the lease of the 
computer for the project. During the last three years, validated 
CAI materials developed during the first phA5^ of the project have 
been placed in classrooms, and evaluation studies have been under- 
taken. Although small instructional packages were developed during 
this period, most of the emphasis was on impleanentat ion of more than 
40 modular instructional packages. CAI capabilities were extended 
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to a junior high school and to a first grade classroom at one 
elementary school. The instructioqsl objectives and CAI applications 
for each grade level and subject area are described^in this report, 
as are the evaluation findings and suggestions ^ for further research 
and developaient. Some comments on possible future directions for 
CAI in public schools are also Included. 



Durvard, M. Lynne. The Evaluation of Computer-Based Instruct ion in 
Vancouver Secondary Schools . Vancouver Board of School Trustctes (.Btitish 
Coluabia). Department of Planning and Evaluatioa, 1973. 119p. ED 088 919. 

This study was undertaken to examine the status of computer-based 
instruction in Vancouver Secondary Schools for both coi^>uter science 
courses and traditional courses Vhich use the computer merely as a 
problem-solving and learning aid. Ten schools participated in an 
examination of the computer science courses. This aspect of the 
study consisted of five parts: - a^^ questionnaire to teachers, a 
questionnaire to students, a set of problem for students to treasure 
"their problem-solving ability, obarervation o^ three computer science 
classes in progreiss, and administration of the computer programmer 
aptitude battery to one computer class. This study summarised the 
findings of the teacher and student questionnaires regarding computer 
based instruction. Observation of three computer science classes 
generally supported the results of these questionnaires. The perform- 
ance of the students on the programming probl^is indicated that they 
were capable of at least fundamental programming. Examination of 
student performance in one class on the computer programmer aptitude 
battexry demonstrated that the computer science course had helped to 
improve the students* reasoning al>illty. Included in the appendices 
are the student and teacher questionnaires, problem sets, ppmputer 
games, and examples of computer programs written by 'students. For 
relatf^ documents, see, ED 088 913 and 920. 

/ 

Eastmond, Nick. Instructional Development under the Microscope: Perceptions 
of Faculty Members . Utah State University', Logan, Merrill Library and 
Learning Resources Program, 1976. 65p. ED 112 882. 

The 1974-75 school year marked the fifth year of operation for the 
Division of Instructional Development at Utah State University. The 
model for instructional development (ID) consists of four parts: (1) 
developing faculty awareness; (2) capitalizing on faculty initiative, 
primarily through small-scale funding under a program of minigrants; 
(3) conducting faculty support activities where participating faculty 
members are released full-time for one quarte;: to work intensively on 
a project of their own choosing; and (4) working with an entire depart-- 
ment to revise particularly important steps in the curriculum for its 
graduates. Through a series of survey techniques and interviews, this 
study gathers data about the program as perceived by faculty members. 
The conclusions are that there is considerable awareness of the ID 
programs across campus; that ID should not move entirely from individ- 
ual-centered to department-centered activities; and that the program 
is generally held in high regard by USU faculty. One-third of the 
docimsent consists of instruments used in the survey and responses of 



participants. 
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Deblools,^ Mike. Reflections on Instructional Developiafent at Utah State 

University, Candid Comments on an ID tienter's Beginnings ^ Utah State 

University, Logan, Merrill Library and Learning Resources Program, 1975. 

15p. ED 112 881. . 

An on-going evaluation is being made of Utah State University's 
instructional development endeavor; this paper has emerged frpm a 

question answer interview with the director of the prografa by an * * 

external evaluator. ' The director describes the instructional davel- .* 

opment program, which is designed to improve the teaching/ learning 

process by developing in professors a» interest in learning theory, 

team teaching, computer-assist^ instruction, simulations, seminars, * 

the lecture, and self-paced instruction/ the model chosen f or ' 

implementing the instructional improvement program consists of 

three stages: (1) awareness leveL, for which the literature on . 

instructional renewal was surveyed and pertinent information sent 

to professors; (2) initiative level, for which minigrants were \^ 

awarded to professors who wanted to develop a new teaching strategy; 

and (3) the instructional development level where participating ■ } 

faculty members are released full-time for one quarter to worK on a ^i^- 

project of their own choosing. The director conclxides that the model 

has enjoyed modest success, that they are in the process of modifying 

it, and that they are pleased that it is making some contribution - i ^ 

toward improving teaching and learning at a' small university . ^ ' 

V 

Ellson, Douglas G, and others. The Tech Programne; Self ^Instructional r 
Programme fpr English Listening Comprehension. Filial Report, Sou theas t 
Asian Ministers of Education Organization (Singapore) , Regional Center 
for Educational Innovation atid Technology,, 1973, <45p» ED 084 929. 

The Regional Center for Educational Innovation and Technology (INNOTECH) ^ ^ 
of the South East Asian Ministers of Education Organixation (SEAMED) 
evaluates its self-instructional program for English listening compre- 
hension in this final report. Th^ program was designed for students 
whose English language proficiency does not enable them to follow 
courses at INNOTECH, which are conducted in English, and it was intend- 
ed both to develop their listening skills in technical English and to 
expose them to part of the actual Il^NOTECH curriculum. The course con- 
sists of 50 units recorded on cassettes, each with an oral passage of 
200-800 words lasting from two to eight minutes. The tapes are supple- 
niented by printed material which includes questions, answer keys, 
transcriptions of the texts, and step-by-step instructions for the 
program. The course was found to be effective in improving the aural 
comprehension of technical English at least as much as the former pro- 
gram which involved five months of classroom instruction. In addition, 
the report emphasizes its economical aspects; programmed materials and 
cassettes are used rather than teacher time and more expensive record- 
ing equipment. Included with the report are two appendices; one gives 
the introduction and instructions from the program material and the 
other provides sample^ of ^ the printed program material* 
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Eagle^, Nick.* An A for A^P, AppaUchia vll,' a5, p26-32i Apr-May 1978. 
EJ 184 -030. y ' ■ . 

Maryland teachers rate' the Appalachian Education Satellite Program 
(AESF) courses in remedial reading very highly. ; 

' r ■ ■ . ■ ■ ■ 

An Evaluation of Educat tonal Media Programs in Kansas Unified School 
Districts > Kansas State University, . Manhattan, College of Education, 
1972, 120p. , ED 070 291- 

A study was conducted to ascertain the level of sophistication of 
the educational media programs in the Unified Public School districts 
of Kansas. It was hopc^i that the resulting data would enable public 
school administrators to accurately evaluate their programs and to 
improve the total educational media program in their systems. Using | 
' the survey method and appraisal techniques , the investigators polled / 
311 districts. Fulton^ s Evaluative Checklist in revised form vas 
the only instrument used to collect the data. Ihe investigators con- 
cluded that many of the districts did not have adequate budget pro- 
visions for educational media and that there was not a wide variety ^ 
of instructional materials being used. 

Evaluation of and Information Cpnceroing Individually Prescribed Instruc- 
tion in Mathematics (IPX); 1967-1978 > Ftiends, School^ Wilmington > Delaware . 
Research for Better Schools, Inc., Philadelphi-a, PA, 1968. 38p. Available 
from Research for Better Schools, Inc., 1700 Market St., IPhiladelphia , PA 
19103. ED 036 161.** 

A self-evaluation of Individually Prescribed Instruction (IPI) in 
mathematics made by Friends School is Justified and presented In this 
report. First, the establishment of six objectives (student indepen- 
dence, mastery of basic skills and concepts, achievement rate and , 
level; teacher diagnostic functions,' prescriptive functions, and 
interactive functions with students) for the IPI program is described. 
Then, the objectives are examined in detail, with statistical data, 
observations, and conclusions for each of the six. 



An Evaluation of the Instructional Television Program Basic Education ; 
Te aching the Adult . Curriculum & Evaluation Consultants, Merchantvllle, 
nJ; Maryland State Department of Education, Baltimore, Division of Instruc- 
tion,, 1976. 8Sp. .ED 128 579. 

A series of 30 telelessons and an accompanying manual designed to 
""train teachers of adult basic education were developed by the Maryland 
> State Dep^'artment of Education and then utilized and evaluated in 25 
colleges and universities throughout the United States. The purpose 
of the evaluation wSs to describe the types of courses, students, 
faculty, and instructional prociedures involved; determine the effec- 
tiveness of the program; and survey the reactions of faculty, students 
and state-level personnel to the program. Questionnaire survey forms 
were used to gather information about the nature of the courses, 
students, and instructors. Evaluation reports were used to gather 
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infonw^loh f row students axsd faculty- about ^ei^^^^ 
leason, A critfsr^on referenced teat vaa admlaiite^^ 
' at /the coapletipn of instruction/ Of* the 430 atudents^^^^^'^ • > * 

schools, 356 compl^ete* both, prer- and>^pcat treats. /St^^ 

recJeived frow 3$ persons , Concluslb^' d^natfrated^^^ . ^ ' '> ; ^ 

program and t^e feasibility of ia^lemienting it I in a ovarii ^aya >^ 
and* settings, ^.^^l^^e findings ^rego»^ - * ' ^ 

■/ ■i instruaent^ are^ included . ■ . ' r ■ '^^"^''"T^ ^ ' ' -^^^ 

An Experimental Approach to Developing Jtod el tio^x&m fot^ B^rly Ghildhood C i v'^p' ' i:''; 
Eaucatton. Final Report . Kern County Superintendent of Sclwipli , Bak;er^ '{ ^ *" ' Ij; 



field. CA, 1971. 91p. ED 088 559V " ' V v ■ i i ^ ;/'/ 

^Tj5_deioonstrate • that individualized preaci;ip tive |Jc^stiriacti^'^^^^ 
fiiaprove facility in oral language ^ a preprim^fy 



V1 ' - ' 



(ftlass for children 

•three to five years of age was estalslish^ :in\Bal^ i: ; 'I 

. . priory class for children six through ^^eight, 'ye^^sr^^ estkb"- ' • ' ! 

i '■ lljshed in ■'nearby Shafter, All .|»u|iilft.; w^i?e ,W ^idra^^^ ■ * " 

\ had no observable physical or ejMtinhai problpia^/ «itn^^'^^^^ 

wide x;ange of - socioeconomic backgrounsis. All pmpi^s had' 4^^^ 
/Specific oral i»nguage skills/ The innoyatlve WB^hc^ utltia^ ' 
\ viHually presctibed instruction in oral language^ Wdiii^Jn 
\ wide variety of teacher-aaAe materials, tape 'recorders » celepliojves 

flashcat<d readers, f ilmstrip-r^corder combiBiations,; Smo i^lo]^' pro^e^- u , 
tors, and Polaroid camera^. Test results on a varieity ofaeSisuring . 
instruments showed g[ains in- both the \p^ep^i»**y and primary classes;'.' 

\ ■ ; ' - \ ' 'V'* ' '[ t 

^Feasibility Study of Cpmputer Aisisled Instruction in,US Arnyv^asjc ' 
Electronics Training. ' Final Report^ Aray Signal Ci^nter and Slphooli Fort 
Honmou^h,. NJ\ "International Business Machines Corporation^ "GaithersbuM;, 
'MD, Federal Systjems DiviJsion, 1968. 198p. ED 095^Si23. . . A 

~ ' ^ ' ' \' ^ ~ . ■ N)' 

A §tudy of cd^puter-assisted instruction (CAI)^for US^Army basi^c, ^ 
electronics training at the Army Signal Centner and School estab- ^ " J ^^di^ 
lishes the, feasibility of CAI as a tfaining technique^. Three aspects 
of CAI ar^ consi3e|:ed: effectiveness, efficiency, and the applica- ^ 
bllity of CAI to basic electronics training. The study 'expires the ^ . 
effectiveness of the learning *ach;Leved by the studeijt and the- "timfe 
required to complete the course material. An analysis of current * \ 
training cos^s cplopared to estimat^es of CAI costs is^ used to^ e^t^l^sl\ 
the efficiency of a Qj^l training system. CAI i& shown ^o he ^ppliciible^ 
Army training methods and educational strategies as w^ll as to ne<7 
I communication and electronics equipment Bjainteriance training. 
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FtiOirle, Carl C. Indlvidualiged Prescribed Iiiatruction; A Critique / Univer- 
sity of Missouri, Colui^iai College of Education, 1970. 16p. ED 041 462. 

The Learning .Research and Development Center at the University of 
Pittsburgh has adopted instructional material in elementary aathe- 
watlcs and reading that are designed for instructing the individual * 
pupil. The prbgram.is known as Individually Prescribed Instruction 
t (IPI) and has been widely acclaimed' as an important breakthrough in 

education. This twnograph evaluates the IPI program, both from the 
standpoint of the student and of the tesdher. It lays down guide- 
. lines for administrators who are considering using the program in 

. their schools, • 



' Felsenthal, Nonton A. Sesame Street: Socialization by Surrogate , ^ Paper 
presented at the annual meeting of the Speech Communication Association, 
j:aiica^^ IL, December 30, 1974, lip. ED 105 987. 




This pap^r reviews -some of the controversy surrounding- Sesame Street's 
treatment of the sojcialization progress of preschool television viewers. 
Ex a m ined in detail are those portions of Sesame Street programs which 
contribute to children's learning of afocially acceptable attitudes and 
beii^vlprs. Some comparisons ^re made between programs aired durinlg 
tne ihiiiiial 1969--70' season and a sampling of the more recent program 
s flagmen tsV; Research proposed by the Children's Television Workshop and 
tli^'iJiarvard Center for Research should . provide additional information' 
concemifig* Sesame Street's ability to positively affect the behavior 
youn^chil^ren, ' 



erj Kathleen and others. The Effectiveness of Video-Autotutorial 
ruction for ^ Very Large Enrollment University Course in Science . Paper 
presented at the^^^^^^^ of the Western Psychological Association, . 



. Los. An^eles^^ CA, Ajiril .8^11, 1976\ 6p. ED 143 694, 

The ef fectlva|iegs of videtJ-autt^tutorial instruction in a large enroll- 
ment cbtir^e Vas' <Jpritrasted to more* traditional instructional approaches. 
^ Slibjec^^ were 555 students enrolled in introductory genetics courses at 
three iJfiivi^raity, 6^ California campuses. The experimental approach 
used 25'^miriute videc^tape modules, a detailed syllabus, and a learning 
, • c^ter staffed by faculty and teaching assistant^. One-way analyses 
V of Varian9i?:on both pretest and final test scores indicated significant 
^ dif^6renc^s among th^ -.groups. Multiple regression analyses were per- 
' * fbi^mfd to estimate the relative contributions of student background 
vai^iAbles, pretest perlf ormance , arid ins'tructional treatment on final 
test scores as the* criterion of achievement. Considered singly, the 
most potent predictor was" instructional treatment, followed by grade 
point average^ and ^ then pretest performance. jjT 




^Plaugher, Rooald L. and Knapp, Joan. Report Qn Evailuation Activities of 
the Bread and Butterflies Frojecj . Educational Tejstinis Service, Princeton, 
N J, 1974. 103p. ED 097 921. 



The Bread and Butterflies series of 15 television, prograas on career 
development for 9- to 12-year-olds was evaluated. The evaluation 
sought to an^er these questions: Was/ the program appi^aling to the 
' students? Did tije students comprehend the program? Were the educa- 

• tional objecti'^es met by the television program alone?. And were , the 
educatioTjil objectives met by the television program plus the class- 
room vrfivities? The methodolo'gy of the evaluation included student 
questionnaires^ student interviews, teacher ^estionnalres, expert 
judgment, attention measures, and observers. The series of televi- 
sion progr^is was proclaimed successful only if "the goal vas to pro- 

• vide an affective stinmlus. No effect was observed pn^he achieve-^ 
» ment of specific behaviorally-def ined educational objectivea# 

Fletcher, J, D. and Atkinson, R. C. Evaluation of the Stanford CAI Program 
in Initial Reading. Journal of Educational Psychology v63, n6, p597-^02. 
Dec 1972.' E J 068 (^74. - . ' > 

Data suggested that computer instruction benefits both girls and -boys, 
.but that it is relatively more effective for boys. 

Ford, John D., Jr. and Sloughy Dewey A. Development and Evaluation of Com- 
puter Assisted Instruction for Navy Electronics Trainings 1. Alternating . 
Current Fundamentals ."^^M^^al Personnel Research Activity, San Diego, CA,. ^ 
Navy Training Research Laboratory, 1970. 38p. Available fro^i'the Clearing- 
house for Federal Scientific «tnd Technical Information, Springfield, VA 
22151 '<AD-706-728) . ED 042 950.* . 

' The report presents results of. the development and evaluation of the 
first compiler assisted instruction (CAI) course segi^nt for basic 
ettectronics. Following student tryout and revision, the CAI segment 
was evaluated by comparing achievement and time scores of students 
who received training on the CAI segment with those receiving normal 
classroom training. Fifty-one students were randomly select-^d from 
/ classes and assigned to CAI. The remaining 20p students in these 
' classes served as the control groups At the end pf the training, 

both groups took^the Standard Army School Examination on this segment, 
and a supplementary test covering school objectives not test-ed by the 
particular school examinations in use at the time. Posttest perform-^ 
ance and speed consistently favored the. CAI group. (The document 
includes seven references and 1^ tables and figures.) 
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Fowle», B«rlx«ir« R. Black and White and Read All Over; Acquiring Litesacy 
in TSao Media * Paper presented at the anauai meeting of the Aaerican Educa- 
tional Research Association , San rrancisco, GA, ^rii 19-23, 1976. 16p. 
ED 126 941. 

/The Electric Company CTEC) uses a television format to introduce 
> young viewers to the concepts of phonetics and word recognition. 

Though^ its presentation is intended to strengthen fundamental read-, 
ing skills, some presentations tend to confuse viewers because they 
mix the essential attributes of print code with the incidental 
attributes of the television presentation. This is especially 
trtte for preschool viewers. This monographic examines the instruc- 
tional objectives of TEC and criticizes the format of the 'program 
by providing examples of misleading presentations. \ w 



Freedman, Morris.^ New York City's Decentralized Media Pfogram. Audio- 
visual Instruction vl9. n7, pi8-19. Sep 1974. E J 104 574. ' . " 

An evaluation of the media programa in New Yort City's decentralized 
school system. 



Frychter, Dorothy and Higginson, George M. An Evaluation Report of Project 
INTERACT; A Teacher Inservice Training Course on Career Education Using Two- 
Way TV in Texas to Several Groups Simultaneously . Educational Development 
Corporation, Austin, TX, Needs Divisioii, 1975. 66p. ED 110 076. 

A third party evaluation was conducted of an experimental inservice 
training program XProject INTERACT) in career aiucation using *duplex 
(two-way) television tcreach several groups in different cities 
simultaneously. Two main aspects of the project were under study: 
the particular curriculum content pn career education and the use of 
the Texas Telecon|)uter .Grid. The Texas Telecoaputer Grid, a tele- 
conmunicatfon net3^ork, is operated by Central Texas College in Killeen,. 
with satellite facilities located in Dallas, Fort Worth, and San, Antonio 
The pro J 8^ evaluftion relied on two main inputs: questionnaires com- 
. ' pJleted pen>4icaliy by the participating teachers and review of the 

programs by an^dvisory committee of media and career education experts. 
'Results indicated that staff dedication was high, but that th^ program 
was impaired by mechanical failures of the grid. It was concluded that 
the grid is a useful teacher training device^ for certain purposes .and 
under certain conditions. An appendix includes examples of all the 
instruments employed -itk the evaluation. 

Caddis, G. Warren. Evaluation of Televised Electronics Instruction Program . 
Utah State. Board f ors^ocational Education, Sa^jt Lake City, 1973. 30p. 
ED 086 186. 

* ^ • 

A research study in Utah had two obj ectives : (1) to deterj^ine the 
extent of the dissemination of a new vocational electronics" curriculum 
guide among the state*& electronics! teachers, and (2) to measure th^ 
value of an iftstruc tional television program for teachers as a means 
of disseminating the guide. Questionnaire results, which must be 
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regarded as tentative due to liidLted retumat Indicati^ tbat uae of 
the guide vas increasingly widespread . ami that it vas^ eaployed sainly 
as a teaching guide and as a reference* Vievers responded tl^t they 
were using new methods, materials, and equipment » and that they gave 
more attention to helping students to enter the labor market. Admini- 
strators were indifferent to the program and the electronics teachers 
remarked that other types of disseminarioh activities^ such as work- 
shopSi were also needed. It was recqma^nded that future dissemination 
and instruction program£i be revised to facilitate the examination of 
specific behaviors, that better evaluative strategies be developed, 
and th^t alternative disseudnation and teacher inseirvice methods be 
considered and experis^ntally tested* ^ ^ 

Gailitis, Maris M. The Costs of Information Retrieval Television. A Case ^ 
Study in the Cost-Ef gefctlveness of EducatTional Media , Ontario Institute 
for Studies in Education, Toronto,, 1972, 87p* (Occasional Papers' Number 
12.) ED 073 706, ^ 

The Information Retriev^al Television* <IRTV) systeti was a unique experi- 
N * mental media program initiated in several Ottawa^ Canad'a, schcK)ls in the 
Fall of 1968. The program allowed teachers to"^ select televised amdio-^ 
visiisl* programs for their classes at any time. This arrangement freed 
them from having to adapt to broadcast schedules or to the rigidities 
of existing film distribution methods. The IRTV system was tested for 
nearly three years and detailed records of the^ costs Of the system were 
systematically kept. This report shows the type of considerations that 
must be taken into account by administrators and planners when organizing . 
an efficient media system. Comprehensive in scope, the report concluded 
that it is unlikely that IRTV can ever be cost^ef f icient until it becomes 
a self-contained mode of instruction in some part of the learning environ- 
ment , Though the conclusions about IRTV were not favorable, the method- 
ology used to develop a cost-effective ratipnale should be of lasting 
value. 



Gohring, Ralph and Chiarelott, Leigh. The Use of a Simulation Game to Assess 
and Influence the Leadership Styles of Elementary Principals: The Principal 
Game. Paper presented at the annual meeting of the American Educational 
R^arch Association, New York, NY, April 4--8, 1977, 34p. ED 137 362. . 

Results are reported of research to test whether a simulation game can 
be used to identify and'to influence the leadership styles practiced by 
/ el'eflientary school principals. The design assesses whether prinqg^als 
can become more skillful decision makers through heightened awar^ess 
of their leadership styles. The research and educational implications 
of the study contribute to ^^middle range'* theorizing. Application 
lies , between general managerial and systems theory, and the day-to-^day 
decision making of the elementary school principal. '^The Principal 
Game''^ simulation, and the research surrounding it, represent an attempt 
to br;idge. the gap between theory and practice. 
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Goollby, Thboaa M. , Jr. and Stoltnan, Joseph P. Report on art Individual- ^ 
ized Reading Skills and Social Scianc6 Pro|;rjai in Progrgss . 1973. 13p- " 
ED 069 654, 

Developxaent of th« Individualized Reading Skills and Social Science 
progran (IRSS) Is described.^ This curi>iculua begins when most 
childt'en- start to r^ad. If a child cannot read the page, the 
curriculna provides supplest tary listening passagias and readiness 
training assessssent. > Each child begins at' his level of progress. 
The general structure* of the materials is short passages followed, 
by 4- response multiple choice questions. . The social aci^ce Content 
includes site, route, and boundary cotaponentsj interdependence of 
^ components; economic, political, and social aspects of components; 
environmental quality of cdmmunity;' and con^arlson of conmnitiea 
in different parts of th^ world. The first segment of the IRSS . 
program (1970-1971) was pilot-tested and analyzed in 1969-1970. 
Evaluation of an expanded field test in 1970-1971 indicates an 
absence of cooperation in administering the program at the class- 
room level. 

Graf, David L. An Evaluation of the Educational Media Service Programs 
In the. Universities of the Big Eight Conference . Ed.D. Thesis, Univer- 
sity of Nebraska, 1977. 351p. Available from University Microfilms,' 
P. 0. Box 1764, Ann Arbor, MI 48106 (76-25902). ED 130 630.* 

As part of a study to determine the adequacy of educational media 
services programs at Big Eight Universities as perceived by faculty, 
department chairmen, and media directors, an instrument was developed 
which asked participants to evaluate 44 elements of media service 
programs. In general, responding groups were in agreement, and 
seven of the eight y«6tltutlons were perceived as adequate. Local 
production of materials was assessed as the most adequate attribute, 
while budget and staffing provisions were judged 'most "inadequate. 
This report describes In detail the background and procedures for 
the study, and the results are analyzed and suimnarized by institu- 
, .' tion and overall. 



Grant, William D. and Clark, Norma. A National Survey of Current and 
Anticipated Media Equipment in Residential and Day Programs for the Hear- 
InR Impaired . Model Secondary School for the Deaf, Washington, Dp, 
Office of Research and Evaluation, 1974. 95p. ED 100 073. 

Five investigations sponsored by the Office of Research and Evalu- 
ation (ORE) of the Model Secondary School for the Deaf (MSSD) are 
reported. Presented first are results of a national survey (April 
1974) of media equipment in 123 residential and day programs for 
the hearing impaired, in which the number of cassette video 
recorders and color video monitors was found to be increasing the 
most. The second report is an evaluation of the Computer Assisted 
Instruction Mathematics Strands Curriculum, based on its use (1971- 
73) with 86 students at MSSD whose achievement on the Strands did 
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not 'relate significantly to achieveiaeat oil the Stanford Achieveoent 
Test math subtest. The third article consists of four suggestions 
(such as specifying objectives) to aid teachers in developing student 
attitude questionnaireia. A aanual which ORE has utilized to collect 
teacher generated data during formative evaluation of MSSD projects 
is provided. Reported last is ^ formative evaluation (1973) of an 
in*-house developed unit of GeneWg Art II Vhich, when used to teach 
► six basic terms describiag textJ^ to a sample group of eight MSSD 
students, resulted in all Ss ^attaining 100 percent level of accuracy 
on cognitive post tests. 

Cropper » George L, Development of Course Content and Injstructional 
Materials /Aids for the Training of Educational Research^ Development, 
Diffusion, and Evaluation Personnel. Supplementary Final Report . 
American Institutes for Researcli in the Behavioral Sciences, Pittsburgh, 
PA, 1974. 116p. ED 085 349. 

This report evaluates a program which trained participants in the 
Instructional design process and indicates how' effective it was for 
training instructional design personnel. The program was adminis- 
tered to three separate groups on separate occasions (N»8^ N-6, 
N»3). The program, being self-instructional, allowed students to 
vprkat their own pace, but they did participate in group discus- 
sions. The following data were gathered:/ time to complete reading 
and exercise assignments, errors on work^iook exercises (constituting 
criterion-like tasks), and student coTwaeiits. Analysis of these data 
^revealed that the program worked well. Student comments were 
generally favorable. The only revisions in the program were made on ' 
the Instructions to students on how to use , the program. Recommenda- 
tions are made for further evaluation of the revised program. The 
appendices include information on workbook error rates; results of 
final exercises; and participants V comments on overall evaluation, ^ 
other models, the handbook, and diagramming. Twelve tables of data 
are presented. ^ • 

Hall, Keith A. and others. The Development, Implemexttation and Evaluation 
of a Pil ot Program of Computer-Assisted Instruction for Urban High Schools: 
General Mathematics and Aljaiebra I. Sumroary, Report . Pennsylvania State 
University, University Park, Computer-Assisted Instruction Laboratory, 
1971. 25p. ED 076 053. 

Algebra I and general mathematics courses using tutorial instructional 
programs under computer control supplemented by "off-line" materials 
(included in the computer controlled testing) have been developed for 
3 ninth grade student population. This summary report (preliminary 
re^ports are RD ^076 045 and ED 076 048, and the teacher's manual is 
ED 076 052) describes the structure of the individually adaptive 
curriculum, the computer. system, and the curriculum development, 
E\^aluations involving both norraed and non-normed achievement tests 
suggest that students achieve at least as well with the use of computer- 
assisted instruction as from conventional instruction .alone. 
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Hall, Keith A* &ad others* Xxiservice Mathematics Education for Elerontarir 
School Teachers via Contputar-Assisted Ii^trijction (Calif onila)V In^ 
Report s Paxmsylvanla State Unlvaraity^ UniVaralty Farii^ Coii9uttr--«Assiated 
Instruction Laboratory, 1969* 59p. ED 076 043 • 

A field test of a computer- ass Is ted litstruction (CAI) program of 
inservlce education in |»>dern mathesatica axid sathematics teaching 
methods for eled^ntary teachers was conducted at California, PA, in 
the auamer of 1969. ^ The course, called "el»ath" consisted of 80 
percent mathematical content and 20 percent teiaching methods, with 
the methods unit intersperscui throughout so that each would be 
studied itamediately following the presentation of related content* 
Results ^f varlouis analyses of data gathered during [the course frqm 
the 130 participants showed that the program was effective in pro- 
viding inservice education for teachers of element^^ry school mathe- 
matics and other educators, that the program lacr eased favorable 
attitudes toward mathematics, that the content of the course was 
probably learned faster in the CAI format than in a conventional 
classroom, that the course needed several revisions, and that both 
high and low achievers expressed favorable opinions toward CAI* 
Appended are a course description of '*elmath*' and a student opinion 
questionnaire., 

Harlen, Wynne. A Critical Look at the Classical Strategy Applied to 
Formative Currlclum Evaluation, Studies In Educational Evaluation vl, nl, 
p37-53.^ Spring 1975^ EJ 131 787. 

During a seven year period, science materials designed to promote 
discovery learning for children aged 5 to 13 were ^developed and 
revised on the basis of ^ formative evaluation. Student and teacher 
data were analyzed In order to determine which curriculum materials 
contributed to cognitive and affective objectives. 

Herbert, Budd. - The New Tovm Game: An Evaluation Based on Instructional 
Experience, Simulation and Games v3, n3, p349"60. Sept 1972. EJ 069 044. 



Heflin, Virginia A. and others. The Formative Period of USTEN LOOK LEARN , 
a Multi- M ed i a CommunicatlQn Skills System . Educational Development Labora- 
tories, Inc. , 'Huntington, 'NY, 1971. 70p. ED 049 019. 

A two-year study was conducted in 1965-^67 for the following purposes: 
(1) to evaluate the materials and techniques of a new beginning read- 
ing program, the LISTEN LOOK LEARN (LLL) Multi-Media Communication 
Skills System, in order to make revisions where necessary and (2) to- 
compare the LLL system in its formative stage with that of basal 
reader programs. Questionnaires and continuous feedback cards ^ 
supplied to the teachers provided a detailed subjective evaluation 
of the materials and techniques. An objective evaluation was carried 
out during the second year by administering standardized tests to 570 
pupils in 21 experimental classes taught reading by the LLL system 
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aod 627«puplls in 25 control clashes whichr used the basal reader. 
Metropolitan Reftdiaess Testing in September 1966 jshowed no signifi- 
cant difference between the two groups/ ^en the Metropolitan 
Achievement Tests, Primary ^IBatt^ry, were administered in the spring 
of 1967, there was a sigijlrflcant^ favoring the experimental 

group pn all subtests. Children with higher intelligence and greater. * 
readiness for reading were challenged by the IXL system and made 
greater achievement than similar children in the ba^^al prq^rajo. 
Tables are included. 



Helpio^ Leaders Help Youth. An Evaluation Report of a Program for Illinoiis . * 
Volunteer 4-H Leaders, 1973-75 , Illinois Unriversity, Urbana, Cooperative 
Extension Service, 1975- 17p. ED 141 000* \ 

Conceived by the staff of the University of Illinois Cooperative 
Extension Service as a means of aiding county extension advisors 
in working with volunteer 4-H leaders in Illinois, "Helping Leaders 
Help Youth" employed a combination of vinyl sound sheets f or , home 
study and a leader development meeting series supported by audio-^ 
visual aids and printed materials. Evaluation of the project " / 
involved: (1) 1973-74 phone surveys of the facilitating advisors; 
(2) 1974-75 case studies of five of the original 12 counties in the/^ 
project (one urban, two rural, and two rural-urban categories), 
including interviews with volunteer leaders (N'«81) , others indirectly 
associated with 4-H activities (N*2^) , six youth advisors, and the v 
f v.- • project's on-campus director. Results indicated that youth staff 

qiiickly became advpcates of the leader development 'series' ready-made 

package; volunteers could offer profound insights into the* large • . 

demands facing leaders at the grassroots level; use of the vinyl , 

sound sheets presented media orientation difficulties; major voluntjeer 

concerns were time and travel, leader recruitment program planning, 

and social learning; and major staff concerns were lack of previous 

volunteer training, the facilitator rdle of county advisors, and the ; 

need for delivery systems to reach leaders in isolated areas. 

Hezel, Richard I. and Neubert, Nancy Malecek, The Allegheny Educational. _ 
^BYoadcast Council: Instructional Television in Central Pennsylvania . "^'^ 
Agency for Instructional Television, Bloomington, IN, 1977. 26p* Availa- 
ble from the Agency for Instructional Television, Box A, Bloomington, I^ ^ 
47401 (free while supply lasts). ED 156 168. 

Instructional television (ITV) program evaluation interviews were 
conducted with administrators, teachers; and media specialists in a 
junior and a senior high school serviced by the Allegheny Educational 
Broadcast Council (AEBC) . From these interviews, factors whi<;h con- 
tribute to the use or non-use of ITV in secondary schools were 
identified. Findings Indicated that the effectiveness of the AEBC 
organization and services and the particular school administration's 
management of instructional television were the two principal factors * 
governing ITV use. The background of AEBC and present organizational 
structure and responsibilities are described. 

^ r ' 
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Hamik, Rob«rt C> and others • Television aftd Educatioiial Refona in ^ 

El Salvador. Final Report . Stanford University » CA, Institute for CMaauni- 

cation Research, 1973. laSp. ED 084 810. 

Stanford Unitrersity *s Institute for^ CosBBiinicatioif Reaearch vaa asked 
in 1968 to conduct an evaliiation of a new instructional television 
<ITV) system in El Salvador; to study the effects of ITV on El Salva- 
dor's school system; to derive conclusions from the e:icperience that 
might help guide other nations interested in applying instructional 
technology; and to contribute through research to the development of 
the ITV system. The first chapter Identifies the context of the evalu- 
ations and traces the origins of £1 Salvador's ITV system. The second 
chapter presents the results of four years of research on learning, 
while the third chapter presents a picture of student attitudes across 
the four years of research. Students* educational and occupational 
aspirations are summarised in the fourth chapter » and background 
information on the students, their schools, and their communities is 
presented in the fifth chapter. The next fev chapters report studies 
of teacher attitudes and behavior, studies of the efficiency and cost 
of the new system, and an administrative history of ITV* A final 
chapter reviews El Salvador's ITV system- and concludes with a brief 
discussion of some alternative strategies for the use, of instructional 
technology to expand educational opportunity. * 

Hsla, Jayjia and Strand, ' Theresa. WTTW-ESAA Television Pilot, "TCR '77/' 
Formative Evaluation . Educational Testing Service » Princeton, ^ $ * 
95p. ED 129 889. 

Formative evaluation of the WTTW-ESAA pilot television program, TCR 
'77, was conducted by Educational Testing Service. The pilot program, 
first of a planned television series intended to facilitate the 
desegregation process in our nation^ s high schools, was produced by. 
television station WTTW in Chicago in cooperation with student co- ' 
producer teams. The students provided personalized statements on 
desegregation as it occurred in their schools and communities. The 
finished pilot program, based on three student scripts, was shown to 
1,241 high school students. They were black and white, Asian-American, 
Hispanic-American and Native American, and lived in cities, suburbs, 
small towns, and rural areas in every region of the nation. Students 
who saw the pilot film knew more about, and expressed more favorable 
attitudes toward, desegregation than classmates who had not yet seen 
the film. Section 1 includes the findings of a literature search to 
provide background foir the project. The design of ^he evaluation is . 
described in section 2 and includes detailed information on subjects, 
Instrumentation used, and data collection, processing, and analysis. 
Findings are reported in section 3. Results of questionnaire adminis- 
trations are summarized for subjects who viewed the pilot film. The 
section also includes content analysis of the three pilot segment 
scripts, Q-sort, and distractor analysis findings. Implications of 
findings for future programming are also discussed. Section 4 pre- 
sents the conclusions and recommendations. 
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Hkiao, J. C. The Learning Effectiveness of Kicroeconomic Sifflulatl!on, 
Education v95, n3» p270-75. Spring 1975./ EJ 116 969. 

, This paper repotted an investigation in whi&h student learning in an 
experimental class using a sifimlation was compared with a control 
class where the simulation was not used. 



Individually Guided Education: Description of XGE. Evaluating Instruc- 
tional Systems, Educational Product Report v7, n58, p23-35. Jan 1974. 
EJ 092 657. 7"" . , t 

Evaluates materials used for IGE, a program that calls for one-Co-one 
and small group instruction plus much independent study. Emphasis is 
on reading and motivation materials, and program objectives and imple- 
mentation features are described. 



Individually Guided Education (IGE) Program. X974-1975 Final Report ; 
Austin Independent School District, Texas Office of Research and vEvalu- 
ation, June 1975. 35p. ED 154 493.** 

This report is the continuation report of an evaluation of the imple-\ 
mentation of the^ndividually Guided Education (IGE) program in the 
Austin (Texas) Independent school distr;irCt which began during the 
second year of the program implementation in 1973-74. The eufiluation 
continued to focus this year on the achievement of program i^^jguts, 
processes, and outcomes in 11 IGE and 11 matched comparison school^. 
The major emphasis of this evaluation was on determining program n 
eifiects on student outcome behaviors. Utilized in the study were 
tdther and parent questionnaires; scores from the California' Achieve- 
ment Tests, the Piers Harris Children's Self Concept Scale, the School 
Sentiment Index, a reading, attitude test, a math attitude test^ and a 
student behavior rating scale; and classroom observations. Despite 
some positive effects demonstrated on objectives in the affective 
area, the lack of positive results on achievement led to the conclu- 
sion that the IGE program should be- discontinued. # 

Individually. Prescribed Instruction: Developmental Phase- Evaluating 
Instructional Systems, Educational Product Report v7, n58, p36-60. Jan 
1974. EJ 092 658. 

Evaluates IPX, an Instructional system designed to individualize the 
teaching of subject content. 

Init ial Evaluation of Operation Wordpower , Instructional Dynaiirtcs, Inc., " 
Chicago, IL, 1970, "^T4p . ED 041 977. 

Operation WS^dpower is a reading program reaching disadvantaged 
adults and operating in Chicago' s^ urban coimnunity areas. The pro- 
gram accepts any person who is reading below the fifth grade level* 
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Instruction is by means of the Sullivan Readies Materials adapted 
t& the Edison Responsive Environment teaching technology (called 
"Talking Typew?:iter") i^tll the students' reading ability improves 
to the sixth grade le^el* At this point the students graduate from 
the program, often tKJVing on to other educational programs. This 
report is an evaluation of Operation Vordpcwer. utilizing informs- 
tion already available in the files of each of the f«ur center sites 
for a total of 372 students. Two questionnaires, one to determine V 
student opinion and attitudes toward the progrwi and the other to 
validate student attitudes by using staff responses > were administered 
to students and staff. These data were used to review sttident char'- 
acteristics and attitudes, to determine why students drop out » and 
to evaluate program effectiveness. Findings indicate that the pro- 
gram is effecting an important fxmction in the area of reading 
improvement, but that it must be made more post effective by moving 
to more locations and by instituting a more effective recruitment 
and motivational program. 



Instructional Materials in Manufacturing for Junior High School Industrial 
Arts, Final Report and Parts I-IV, Ohio State University, ' Co Itanbus/ 
1967. 580p. ED 065 731. 

This Title 'XI. institute was designed and conducted to introduce the 
participants to inquiry and invention taking place in industrial 
arts curriculum across the United State^t. The institute particlpat^ed 
in the inquiry stage through advanced study of maxiufacturing tech- 
nology\and industrial arts curriculum, and in the invention stage 
through^ the development of sample instructional materials based on 
this advanced study. This document provides an evaluation of the 
several facets of this institute plus the four volumes of instruc- 
tional material developed. The sample instructional iaaterlals were 
designed so that participants could place into operation a program 
that would improve their industrial arts offerings. 
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Ironside, Roderick A. The 1971-72 Nationwide Installation of the Multiunit/ 
IGE Model for Elementary Schools > A Process Evaluati on. Educational Test- 
ing Service, Princeton, NJ; 1972. 291p. ED 066 6?3. 

The process of installation of specified and instructional patterns 
In more than 200 elementary schools from ten states is evaluated. 
The findings of data gathered from questionnaires, site visits, 
training sessions, and ^interviews represent four major project 
procedures. Eight chapters cover the study as follows: (1) pur- 
poses, background, and summary; (2) instrument development; (3) 
school survey questionnaire; (4) district survey^ questionnaire; 
(5) detailed Installation questionnaire; (6) site visits to^ 
multiunit-IGE schools; (7) installation models and designs; and 
(8) conclusions and recommendations. Included in four appendices / 
^are the questionnaires used in the project: (A) school survey; 
(C) district survey; (E) detailed installation; and (G) visit 
report forms. • (For volume II of this study, see ED 065 624.) 
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Jacobs^, Davi4 A. and Gerlach\ Vernon S. A Cpaparigoa of the Effects of 
TextuJil iind Televised Modes of lostruction in Tesacher Ediicatlon . Paper 
presented at the annual convention of the Association for Bducational 
pOMBunications and Technology, 1973. 28p. ED 074 773. 

« 

Instructional televisiAi (ITV) has generally not shown significant 
differences in idstructlonal effectiveness wfae^ coispar^ to conven-- 
tional ins true tiotissjrechniques* In an effort to' gather 9ore cosu^lu*- ' 
sive data about these previous findings, this study sought to compare 
two instructiosul modes » IT\r and textual presentation* Eleven juniors 
in a teacher educatiop program participated in the study. They 
received instruction in qui»tioning techniques in preparation for 
the subsequent presentation of a videotaped micro teaching lesson. 
The student teacher's performance was observcui and analyzed from a 
variety of statistical viewpoints, and the results indicated that the 
more expensive ITV instruction failed to produce a criterion perform- 
ance which differed significantly from that produced by the less 
expensive textual instruction. . i 

Johnson, Bruce A. and Pierce, John. Research Brings Proof of Value, Future 
Direction to Sales Training, Training and Development Journal v28, nil, 
p25-30, 32. Nov 1974. EJ 105 447. 

McGraw-Hill's behaviorally oriented multimedia sales training program 
uses pencil find paper exercises, tape recordings, and rqle-playlng 
situations. Evaluation of the program indicates improved sales since 
1972 when the program was introduced. 

Johnson, Lary. * The, Fourth Year of IPI Mathematics at Minneapolis Hall 
School: 1972-1973. A Title I ESEA Project , Minneai^lis Public Schools, 
Minnesota Department of Research and Evaluation, 1973; 29p, ED 114 430. 

The Individually Prescribed Instruction (IPI) mathematics project at 
Hall Elementary School in Minneapolis completed its fourth year of 
operation in June 1973. The program is organized on a continuum of 
415 math skills grouped into eight levels according to increased 
difficulty. Students progress through the continuum at their own 
rate as they master math skills. Children in grades 2-6 participated 
In the 1972-1973 project. Achievement scores on the modern math 
supplement to the ^lowa Tests of Basic Skills have improved each year 
of the IPI project. Contrary to children rti many disadvantaged areas. 
Hall students do not compare less favorably with publisher norms as 
they become older; the IPI students hold near the percentile rank 
they had as third graders as they progress through school. Hall 
students have expressed more positive attitudes toward math than 
those in comparison schools. Hall teachers have supported the IPI 
project, emphasizing the Individualized approach and the students' 
positive attitudes. IPI was not to be continued in the 1973-74 school 
year. 



#0 




Joluwotti Lary. MitmeapoXls IPX Hathematics Pro:^#ct 1971-72? Third Year 
Evaluation. A YitXe I, ESSA Project , HinxyeapoXia PubXlc SchooXa^ Hlnneaota 
Department of &eaeareh and EvaXuatioa» 1972. %lp. ED 083 2SK). 

The evaluation of the third year of the IndividiiaXly Prescribed 
Instruction (IPX) matheaatics ptrbject at the UaXX schooX in 
Minneapolis (grades 1^6) Is discussed, and Che resuXts for tha three 
years are suanarized. The procass evaXuation during the third year 
concentrated on three areas; group instructionaX iMthods, instnu:- 
tionaX materiaXs other than the standard teaching sequence bookXets, t 
and prescription practices* To determine vhether the IPX- project 
was success fuX in raising the laedian raw scores on overaXX mathft- 

; matics achlevenentt the basic evaluation techniques used during^ 
the third year were a standardized achievement test, a sa&antlc 
differential attitude scale, a locally developed arithmetic basic 
skills test, a record of student progress in the IPX continuum, 
and teacher interviews « Students in grades 4-6 in two other Title I 
elementary schools were used as a con^arison population. Th^ 
evaluation data are .tabulated and discussed. Results of the study 
showed that ^all students continued to make progress during the 
third year. Students in grades 3 and 4, who had had most of their 
formal math instruction with IPX, had higher percentile ranks than 
students in grades 5 and 6. Process evaluation of instructional 
activities indicated differences between classrooms in usa of group 
instruction, variety of instructionaX materlaXs, and prescription 
practices. Reactions of the teachers emphasized the value of the 
individtiali^ed approach for student achievement and attitude. Fourth 
and fifth grade students at Hall had a more positive attitude toward 
math than did students at the two comparison schools. Appendices 
; provide -the basic operatioiSal skills test for grades four and six' 

. §Jlid the semantic differential scale used with IPX in 1971-72. 

Johnson, Lary and Ostrum, Donald R. y Second Year Evaluation, IPX Mathematics 
Project; Hall School, 1970-71 . Minneapolis Public Schools, MN, 19^1. 60p. 
ED 067 874. X~ 

A potest in mathematics determined the starting point (for low-income 
elementary school students in a 3-year individually prei^cribed instruc- 
tion (IPI) project, in which each student progressed through the IPX 
continuum of skills at his own rate as he proved his mastery of 
successive skills. The results of the first two years of this project 
indicate that the children gained mathematics skills as rapidly as 
average students throughout the county and much more rapidly than 
students in three .comparable lov- income schools. Students rated 
mathematics as one of their favorite subjects, while teachers 
preferred IPI over more traditional math programs. ' 



Kastner, Sheldon. Skin, Scale, Feather, and Fur . New York City Board of 
Education, Brooklyn, Office of Educational Evaluation, 1976. 6p. 
ED 141 486. 

The "Skin, Scale, Feather and Fur'' program was designed to provide 
children in the New York City public schools with knowledge about 

141 
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various aniia^^ \«pec lis skd^eheir "p-lUce 'tii thee „:world . ■ ■ Teairh'^?^^ " ' 



And p«t«prof«s»ioo*l^ «t*f f ■ siting wdth, cK^ ttAtea Isiind, Zool |>«j?sonnei 
developed acHvitU6s ,sndUti*§ru • 
conducted fexpiox'atory leirnil^ sqeivi^^^ ' y ' 

objective fef tAe <program was- jto dff^^ / , < 

participation i;n the program j^O pe^c|»t ^£ the ^p^^ \ . '.. ' i j:. ' 

percent of thi; iqu^atioi^ correct oa ji t^^ n«a»uring knowledge .jSibout ' ' ' j J 
various aniiUl species. Fiv* t»ujfldred pupils in grades ; ? - ; • 

nine participated vin the pTiograa. ^«ta weie collticted st^ents 
in grades twp through £o\ir. A prograa--dev«loped instri^S^t ai»!aWurin^ 
knowledge about Various aaiml »pecijw wai»/a4nini«f:6r^()^^^^^ the 
children had bten exposed to th«^progriia. Ithf fixjdinigs ofl the^-epdrt 
indicated that- 96 percent of thW^ pupils la' grades tiro," [ three, and four 
(512 out of 519) received test scores above 60 percent* ^ ' \ 




Katzenoyer. Conrad and pthcrs. Evaluating ICS'; An It^i tilii Literature 
Review and Exploratory Study. Technical Report; tto. A04 . Wiiicoastn Utkiyer-;- 
sity, Madison, Research and Developii«»nt Center* for Co^itiv^e Lieanainjg.' 1976; % 

198p. ED 134 606. ■ ■ . ■ 1 . ' v",;^ ' \ 
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The results of an initial evaluation study; of itndividually Guided 
Education (IGE) are presented. A matcheci fample of IG£ asid non'-IG£ v 
schools was compared on a variety of direct a^^'d ^indirecie. out(^pae 
measures. Findings indicated general support for Che \acjiieveaufnt of^ ijf 
direct outcomes, with few differences betweaa '.tGE'add cohtjirol schools \, ' /. ! 
shown on indirect outcome measures. Conclusive add reccniiaetidjktiWs 
are directed toward further evaluation efforts isfi^ j^ell sis tc^ i'^l^enti-^" 
fying issues in furthering research and develop&ient oi\ IGE., i • « 

■ ■ - ■ i'.-^. ■.' ' ' r 

Kaufman, Maurice. The Effect, of the DISTAR Instructit>nal''Syst^; ^An ; 

Evaluation of the 1972-1973 Title I Program of Winthrop. ?^gsachuset''t's .4 \ ' . / 

1973. 21p.. ED 110 171. , ■ i ^ T ' ' ' ' ' ' 



This report describes comparative evaluations of the DIS'^AR 1 (f;ir'sc 
grade) and DISTAR II (second grade) programs which were catri^d 6)it 
in 1972-1973, Results^ showed: (1) the DISTAR' program fi^r ^irst / j * . , 
grades had no conclusive advantage over traditional instructipn for ' ' 
the development of oral language or reading achievement; and (2) ^ ♦ » ' 

second grade DISTAR pupils scored below grade placement in wor^ fir ^ 
meaning, word ^tudy, paragraph meaning, language, and arithmetic * \'( \ f " . 
skills. Since children were initially selected for the DJSTAR pro- V 1 
gram on the basis of low readiness . scores , performance below grade * » ■ \ • ^ 
level was not expected. The DISTAR pupils overcome the discrepancy / * j; 

between grade placement and achievement that existed at ^he end of i ! ' ^ 

second grade, and as a group performed at grade level at the end of • .r . 

third gradeu Tt was suggested that instruction with the DISTAR f ^ ' 

system might be improved by providing greater opportunity for childr£*n 
to develop comprehension and sight vocabulary. 
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Kaufaliii, lUujrice. The Effect ^of the flIiSW Iastruetiontti>Sy#t4r: Aftv ' 
jEvalUitt:^on of the 1973-1974 Title I Program of Winthrop. Kaasachusefrts . 
1974. 45p/ ED 110 1710. ^ ' :~ 7~T7 ' 



This report describes the evaluation df thfe 1973-1974 .DISTAR I and 
DISTAR ri prograjas, which were used- as Title I progrJttW f pr the 
first and second graders. pISTAR I was used with two first grade , classes; 
DJSTXR>^ was uWd with two second, grade cl^es. Children who , had 
. ■cooipietea t^ y6ars of DISTAR instrvction received traditibusl 
^"■"5^|]5}stijA|o'n iti^hird grade. The p<>ssible advantages" (achievement - 

in arj^Iflfttic 'computation) and d^advantages {inad^uate word-^taeaning , 
paragraph-i^eaning.-' and arithmetic qonc^pt sJai^^ which 
- were indicated in past comparative analyses, pf the DISTAR' I and II ^ ." 

. pro^r^» wfere reexamined. , Findings suggest thatr<ll) the DISTAR 
pfograrnvfor first l^graders had no ai vantage ovei^"cpnvfeneion<^i instruc- 
tion in developing oral language ability; (2)j the second grade DISTAR 
program was strong in, spelling, word study skills, and possibly in 
arithmetic Computation; aind (3) at the end o/ the third grade, DISTAR 
. •" pupils appeared « to perform approximately at * grade level with distinct 
strength in ar^thm^tic computation, Recomaendations, including pro- 
, posed steps toward redefining Tit,le I populatidns and programs, are ^ * 

suggested. Appendit;es contain dsta tables 'and bther supportive 
material. - ■ > *^ 

;. ■ '. ,'' ^> > 

Keeler, F. Laurence; and Rizzo, William A. An .Evaluation of Microfiche 

Reader Types for TJs6 v^lth Prograaaned Instruction. Phase I, March 1976- 

August 1976 . Naval Training Equipment Center, Orlando, FL, Training 
Analysis and Evaluation Group, 1976. \ 34p: ED 128 006. 

■ . * . , - ) 

The first phjase of a 4-phase study^'on the' effectiveness of microfiche 
as a medium /for onboard training ^ systems examined a, variety of micro- 
fiche readers «fith .respect to ease-of-use,. Ijiading and unloading 
characteristics, and branching to specific microfiche frames. Some 
60 Navy recruits performed branching tasks to simulate the branching 
requirements of prograimaed instruction. Based on equipment- evalu- 
ations and recruit performance, five indexing methods and four types 
of readers were rank-ordered.' Recruits did not experience difficulty 
with any of the readers; however, the Realist/AZantage I reader with a 
grid map index for branching was most highly rated. * 



Keli'y, F. Donald and Byrte, Thomas P. The Evaluation of Filmed Excerpts 
of 'Rogers, Perls, and Ellis by Beginning Counselor Trainees, Counselor 
Education and Supervision vl6. n3, pl66-170. Mar 1977; EJ 156 778. 

• Students .(N=*29) viewed three stimulus films* and 'rated therapeutic 
eff'ectiv^ness of the therapists. Students yjere subsequently rank- 
ordered on the basis df skill development atid assigned to one of 
three groups (high, glddle, or low). , Results fevealed an ovei^ll 
'higher evaluation for Rogers as compared to either Perls or ^llis. 



143 



r 



Kinder*, Steven J-, and Guthrie, John T. The Training Effects of a ^ 
Behavior Modification Game . Johns Hopkins^ University ^ Baltimore, MI), 
Center for the' Study of Social Organization of Schools, 1971. 36p. 
ED 057 613. , - . . 

« 

A game designed to teach some of the skills use4, in behavior modifi- 
cation with slow learners was evaluated. The game^ called '^Modify^-^ 
ing," was de^(eloped to increase the range of experience for students 
preparing to be special education teachers* The randomized posttest- 
only design employed incorporatCKd three treatments: conventiotial 
lecture, .game and Short discussion, and game with longer discussion 
and replay of the game. Two measures of the treatments* effects 
were utilized: a situations*! test of a special edtication classroom 
and a performance test which required each subject to teach a 
special education child a simple paper ^construction task using 
behavior' modification. A recording' was made of the. number of 
positive reinforcements the subjects used in .teaching the child. 
Preliminary results of the study suggest that there is a main 
treatment effect in favor of the game-discussion'-game* treatment 
level- " ^ ^ . ' . ^ 

Klausmeier, Herbert J. and others o A ^eporton the Utilization of Individu- 
ally Guided Motivation. . Technical Report No. 388 ,. Wisconsin University, 
Madison, Research^and Development Center for Cognitiiye teaming, 1976. 
89p. ED 134 559. \ ' , ' • 

This report describes the results of two surveys designed to gain 
information about conditions of implementation and extent of utiliza^ 
tion of Individually Gui'ded Motivation (IGM) in schools across the. i 
, country. The objectives and motivational principles of the IGM 
system and the instructional programming model on which it is base,d 
are presented in chapter I* Each of the four rnqtivational-instruc- 
tional procedures thiV comprise the IGM system is also described: 
(1) adult-child conferences to encourage independent heading; (2) \ 
teacher-child conferences for goal-^setting ; (3) guiding; older * 
children ^ in tutoring younger children; ^nd. (4) small group confer- 
> ' ences to encourage self-directed conduct . In chapter II, the 
purpose, method^ and results of the first survey are reported. 
Conducted in the spring of 1975, it was designed to gather in depth 
jinfonnation from schools in which the IGM system was a viable part 
of the instruct ional* pr6gram. Detailed desci^^pt ions of actual use 
of »ch of the motivational- instructional procedures were . solicited , 
as well as inforuiatioa about those factors that sc[iool personnel 
judged important to successful implementation, fac^prs that caused 
^ probleins in 'using the IGM procedures in the school, and the methods 
used to cope with these problems. Chapter III reports the results 
' of the second survey,- conducted in the fall of 1975. Designed to 
obtain broad information about IGM utilisation from a much more' 
cxt ^sive number of school personnel, as well as teacher educators, 
the specific focus was on access to, use of, and reactions to the 
vatious ICM print and film materials. The finab chapter summarizes, 
the finding.s*of the two survey.?^ and discusses their implications 
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for the impl^iaentation and utilization of the IGM system. Appen- 
dices include a tribliography of IGM. tteteriala. and reports, and 
interviev schedylei for the siirveys. 



Klecka, Joseph A. An Overview of Chanute Lessons , Illinois Univei^sity, 
Urbana, Computer-Based Education Laboratory, 1977 • 78p. ED 140 776/ 

A survey of current lesson development was considered essential to 
determine the quality and effectiveness of instructional material 
produced on the PLATO IV coiaputer-assisted instruction system. The 
trial period lasted for several yeafs. Both civilian and miiitiry 
personnel developed ^the lessons, in consultation with the Military 
Training Centers Group at the Ccftnputer- Based Education Research 
Laboratory, University of Illinoi^^ for tlxe Defense ^vanced Research 
Projects Agency/ Eight representative lessons were selected by e 
Chanute staff member. Then an evaluator prei^^tffStk^n depth reviews of 
eacTi, both in the fqjrmative and suinmative. stages* l>a^a gathered from 
the individual analyses formed the basis for the^ final report; they ' 
indicated general trends and isolated problem areas^ in the instruc- 
tional design. The study resulted in an assessment of the instruc- 
V tional effectiveness and utilization of «the pedagogical capabilities 
of the PLATO system in one training environment. 

' ■■ ^ \ . 

Klein, Stephen P. and others. A Progress Evaluation of Four Bilingual 
Children's Television Shot^s. Paper presented at the annual meeting of the 
American Educational Research Association, 1975* 18p* ED 109 260. 

An evaluation of a fiilin^ual education TV series. was conducted involv- 
ing 6-year-old English speaking, Spanish speaking," and bilingual ^ . 
children at fouj- sites. Children were assigned to control and experi-^ 
mental groups with the latter group seeing four 30-minut,e shows. A 
pre(^est-i[Sosttest design was employed with the pretest serving as the 
covariate in the analyses of the data/ Results indicated stat^«tic^^y 
but not educationally significant effects pf the shows for certain 
objectives, ^The implications of these findings and the factors, that 
may have influenced them are discijssed* ' ' 

Kline, James A, Evaluation of . a Multimedia Drug Education Program. Journal 
-of Drug Education v2, n3, p229-239, Sep 1972. EJ 066 205. ^" 

» 

A 2-'week multime4;La drug education program for junior high schdol 
students Vas evaluated. Twenty-five percent of professed users ^ 
claimed to have stopped using, , , 
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Kreimef, Osvaldo and others. Health Care and Satellite Radio Coggnunlca- 
tion in Villafee Alaska. Final Report of the ATS-l Biomedical Satellite : 
Experiment Evaluation . Listei: Hill National Center for Biomedical Communi- 
cations, Bethesda, MD; Stanford University, CA, Institute for Coimaunication 
Research, 1974. 429p. ED 094 721. 

The executive summary is the first section of this final report of 
the evaluation of the ATS-i medical coimnunication system in Alaska. 
The second section introduces the background of these studies and 
the socio^eographic setting and health situation of the Alaska 
natives. The third section presents the main research findings 
about both the aides- to-doctor and doctor-to-doctor exchanges-, about 
use of the system for medical education, and about its social impact 
on bush Alas.ka. A fourth section is devoted to a cost analysis. of 
alternative systems and reconaaendations. The attachments (charts, 
tables, data gathering instruments, etc.) comprise a fifth section. 



Kulra, George. T he Effects of the Two Summatlve Evaluation Methods on 
Achievement and Attitudes in Individualized Seventh-Grade Mathematics . 
1973. 18p. ED 090 279^. ~ \ ^' ' 

One hundred fifty-nine seventh grade mathematics students were ^divided 
into four treatment groups: (i) traditional , tested after each unit; 
(2) individ^ialized, t;ested aftar each unit; (3) individualized, tested 
aft&r each objective; and (4)^ individualized > chose to be tested after 
each objective. 'Each group w«s divided into high and low math ability 
^ and the achievement and attitude data were analyzed using analyses of 
variance. No achievement differences were found » but significant 
interactions indipated that low ability studeWs with a choice of 
testing methods, individualized instruction, and. test€fd after each 
unit had better attitudes toward piafh than other groups of Iw ability 
^. students. High ability students pr^erred objective testing and were 
satisfied with the status quo. ^ 

Kumro, Thomas and Camp, William L. App:^.ying Programmed Instruction, Man / 
Society/Te c hnology — A Journal of Industrial Arts Education v30,. n7, p228- 
230, Apr 1971. EJ 049 093, ' 

' ■ No significant difference .was found between programmed ins tructed ^and 
conventionally instructed groups in this study of industrial educa- 
tiorf students- 



* Lambrccht, Judith J. and others. An Evalu a tion through Field Testing of 
L"^_i_y.^^iiiAJA^4. Inst ruction Materials in Wis c onsin Pos t~Se c ondary Inst itutes 
Final Report and Appendices* Wisconsin University, Madison, 1972. 278p. 
ED 069 85i. 

To determine the relative levels of achievement of students enrolled 
In courses desi^nnd to permit individualized instruction arid to deter- 
mine those courses or instructional aspects considered, effective or 
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ineffective in achieving objectives, achievement date on l,204^stu- 
dents within the post-secondary institutes of the Wisconsin voca- 
tional education system were gathered from school^ tecords, axid back-r 
ground date were obtained by questionnaire. Critical incidents were 
obtained through personal interviews with 224 students and 28 teachers. 
Analyses were performed contrasting student achievement ai;id the 
critical incidents across subject areas » across technical school 
districts, within separate subject areas, and across five models of 
individualized instruction and four class scheduling patterns. Some 
principal findings were: (1) higher grades dnd fewer coarse incom- 
pletes or withdrawals were received by students who had previous 
experience in the subject, were hlgi> school graduates, and were 
enrolled in an associate degree program; and (2) course character- 
istics which were'most effective -included student-pacing of their 
own programs, use of pretesting to place students within a course, 
student selection of special study topics, and iase of different, 
types of testing procedures. 



Laosa, Luis M. Carrascolendas: ' A Formative Evaluation ^ California Univer- 
sity, Los Angeles, 1974. 203p. ED 090 968. 

A formative research project' sought to test viewer reactions to two 
pilot programs of the Carrascolendas series. A total of 360 PuertQ 
Rican- American, Cuban- American, Mexican-- American, and Anglo-American 
children in grades 1, 2, and 3 were observed as they watched the 
programs. Results indicated that there j^as high eye contact during 
the presentation and that viewers^ frequently smiled and laughed. 
Ver1>al modeling, physical modeling ,^and program-related verbalizations 
weT;e relatively Infrequent. Post tests showed that, on the average, 
students comprehended and recalled two-third's of the material. Girls' 
manifested more eye contact than boys, and eye cont^ctywas found to 
be correlated ^postively with the individual's level of^ perceptual- 
cognitive development and with comprehension and recall, "but negatively 
with verbalization and modeling. In addition,* significant intergroup 
differences were dlsco<?ered for the variables of eye contact, verbal 
modeling, smiles, and laughterv-...^^^^^^ 

Laosa, Luis M. and others. An Evaluation of Non-Formal Education in Ecuador 
Volume 3: Findings. Final Report . California University, Los Angeles, 
Center for the Study of 'HValuation", 1975. 205p. ED 116 881. ^ 

As the third In a 4-volume evaluation report on the University of 
Massachusetts Non-Formal Education ProJeiTt (UMASS NFEP) initiated in 
rural Ecuador in 1973, this volume presents an in .depth' analysis of 
the evaluation findings. Since UHASS NFEP was Initiated for purposes 
of developing new materials and methodologies in conjunct;ion with and 
in support of existing Ecuadorian non-formal education programs, these 
findings are presented in terms of 13 basic evaluation questions 
relative to the following materials and methodologies: (1) the imple- 
. mentation process; (2) the^ degree to which proj^t objectives were met; 
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(3) the intent of the project; (4) the learning outcomes of educa- 
tional games designed to j^romote numerical skills, literacy,, and 
critical consciousness; (5) the characteristics ^of the tiK>re and 
less effective materials; (6) the characteristics of materials that 
worked well with learners of specific characteristics; (7) the 
ifacilitator/teacher variables; (8) the motivational attributes of 

each of the four games selected for in depth experimental evaluation: 

• (9) the change in attitudes and behaviors produced by each of the 
selected non-formal education games; (10) the importance of game 
sequencing factors; (11) the *ef feet of replay possibilities for the 
project; and (13) the components for development of materials and 
programs in countries similar to Ecuador. 

Laosa» Luis M. and others. An Evaluation of Non- Formal .Education in 
Ecuador. Volume 2; Overview and Evaluation Plan- Final Report . Cali- 
fornia University , ^l.os Angeles, Cei)ter for the Study of Evaluation,- 1975. 
98p^ ED 116 880^ " ^ 

^As the secortd in a 4-volume evaluation report on the University of 
Massachusetts Non-Formal Education Project, (UHASS NFEP) in rural 
Ecuador, this volume details the evaluation design. Cited as basic 
to the evaluation design are questions which ask: (1) What kinds 
of effects (changes) can be observed?-* and (2) What are character-- 
istics of the materials and procedures as they can be logically and/ 
or '-empirically related to the desirable outcomes? Cited as major 
components of the design a^re the experimental ^field^ implementation 
and concurrent evaluation of the UMASS NFEP education games that. 
Were among the most widely used/accepted education games, and the 
UMASS Non-Formal Education Intervention Impact Study (an impact 
profile, a qualitative analysis of Intervention based on observations 
and Interviews, and individual testing of game session participants) • 
Additionally, this report describes (1) materials selected for 
University of California at Los Angeles field implementation and * 
evaluation; (2) iris t^ruments (a -set of individually administered tests 

* given in a pre- second-poatt ^ basis to measure, literacy, numerical skill 
and critical consciousness or attitudes); (i) staffing (selection 
criteria^ training, and procedures); .(4) implementation procedures 
(j^election of communities and control and experimental groups) ; and 
(^5) criteria for field supervision and quality control. 

Laosa , Luis M» and others. An E valu atiog of Non-Formal Education in 
Ec uado r. Vo lume I: Executive Suixffliary . . California University Los Angele 
Center for the' Study of. Evaiua'tiort, 197|. 27p, ED, 116 879. 

^ As the first of a 4-voluine report evaluating the University of 
Massachusetts Non-Fomal Education Project (IMASS NFEP) in rural 
Ecuador, this volume presents summary responses to the following 
evaluation questions: (1) WhaL doe.s UMASS NFEP purport to do?,- (2) 
How d6es UMASS NFEP' go about impleuR^nting its goals? (3) To what 

•'extent is^IMASS NFEP carrying outfits intended objectives effectively 

(4) Wliat are the learning outcomes c^f selected non- formal education 
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materials developed hy UMASS NFEP? (5) What are the characteristics 
of the more and less effective materials developed by the project?. • 
(6) What are the characteristics of taaterials that work well with 
learners of what characteristics? (7) What facilitator/ teacher 
variables have affected the relative effectiveness of various 
materials? ^ (8) What are the motivational attributes of each of the 
foiir educational igames selected for in depth 'experimental analysis? 

(9) What change^ in attitudes and behaviors (critical consciousness) 
are produced by each of the selected non-fonaal educational gajMts? 

(10) What sequencing factors/prerequisites are' important for the 
four non-formaL educsttion games? (11) What are the effects of replay 
frequency fior eaph of the games? (12) Can UMAS§ NFEP be replicated 
in other cquntxie^?j (13) What is. needed to develop effective non- 
formal education materials/programs in countries similar to Ecuador? 



Lasater, Mary Beth. Design and Evaluation of a CAI Frogr^ in Chemical 
Equilibrium. Technical Report Number 8 . Texas University, Austin, Computer- 
Assisted Instruction Laboratory, 1971. 45p. ED 073 613. 

* The design, development, and evaluation of a computer-assisted instruc- 
^ tion (CAI) program in first-^year coll^g^ chemistry is described in this 
▼ report. The progrW was centered around the concept of chemical equi- 
^ X librium and used a Systems approach with explicitly stated guidelines. 
The purpose of this ^^etiment was not to measure the effectiveness of 
th^ course content, but rather to investigate the usefulness and effec- 
. tiveness of the particular developmental processes and design technic^ues 
that were employed* The results^of the .program revealed basically that 
\ students with low mathematical capabilities upon entering the course 
take longer to finish the prescribed sequences and that a student's 
criterion score is inversely related to hi^ path length through the 
course. ^ 

» , • ■■ , 

Leinhardt, Gaea. - Program Evaluation;" An Empirical Study of Individualized 
Instruction , > ^Pittsburgh University, PA, Learning Re8earc;h and Development 
Center, 1976. 62p. ED 131 092. 

The results of'tliree years of evaluative Investigation of the univer- 
sity of Pittsburgh Learning Research, and Development Center's program 
of individualized education are described. The s,tudy was conducted 
in seven fallow- through sites and three Pittsburgh area schools. 
Standardized testes were used as input and outcome measures; question- 
naires and videotapes^rwere used to gather information about the class^ 
room processes. The results indicate that over the 3-year period the 
implementation of the program continued to move toward ideal goals. 
Extensive data reduction, procedures were used and the rationale of 
usage discussed. Results also point to input as the primary explana-- 
tion of student end-of-year perf orniance though classroom processes 
contribute a small but consistent amount. The d'ata indicate, greater 
ease in identifying negative factors in successful classroom processes 
than in determining the positive factors. 
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Lenn, Peter D. and Mager, Thomas Computer Assisted/Progratnmed Instruction 
on the Lav> Final Report s American Analysis Corporation, San Francisco; 
Oakland Police Bepartment, CA, 1971. 51p, ED 058 724. ^ , 

Four programmed instruction courses developed in the form of printed 
texts covered the Califorriia penal code, the laws of arrest, search 
and seizure, evidence, and dangerous weapons control laws. The pro- 
granmied courses were used as self-study instructional material for 
recruit training and for in-s«rvice training for policemen. The 
courses proved ,to be effective and economical. The presentation of 
the programed liesfqns at a xomputer termin^;^ was evaluated a^nd found 
to be equally ef fectlve"^ as the print^el material. However ,.>Hie computer 
was found to be less efficiWt in terms of student tirje and\o be more 
costly than the workbook format, ' 

, ' ' ' ■ ' / - 

Levlne, Hard G. and others. Evaluation of a Modularized System of Instruc- 
tion ir» Pediatrics, Journal of Medical Education v52, n3, p213-5. Mar 1977. 
BJ 155 315. ^ ^ ^ 

The Department of Pedia/trlcs at the University of Texas Medical 
Branch developed a inetliod of presenting the didactic information in 
^ pediatrics in a^^^ex^s of instructional modules. Student acceptance. 
, of the modules has b^n very high. 



Lewis, Richard F. Aj Survey ot <1972 Teacher Opinion. Observational Repo¥>»^ 
No> 7217 , Syracuse"city School District , NY , 1972. 16p. ED 092 ;01. x 

The Computer Based Project for the Evaluation of itedla for the Handi^ 
capped conducted a study to determine te^cherfe^ attitudes toward the 
project and, their knowledge of project operations* Twenty--three 
teachers participated Irj interviews focused on three major areas: 
The student, the teachers, and the project. An interview checklist 
of 12 4tems was used by the Interviewers to record the frequency of' 
teacher comments. Completed interviews ^ere analyzed using three 
predetermined attitude categories: positive, Indifferent, and 
negative to the project as defined* in criteria for judgment of teather 
comments. The interviews produced 32 recommendations aiiued at imprOv- 
' ing in^teraction between the project and the teachers. Reconanendat ions 
concerned information desired by teachers, teacher involvement, and 
input in some aspectsof the project to facilitate s tudent " experi- 
ences, and procedures which may assist teachers in understanding 
project services. 
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Liebert, Roland J. "The Electric Company" In~School Utillgation Study . 
Volune Two; The 1972-1973 School and Teacher Surveys and Trends since 
Fall 1971 . Florida State University, Tallahassee Institute for Social* 
Research; Research Triangle Institute, Durhaa, NC,*: Statistics Research 
Division, 1973. 238p. ED 094 775. 

A second-year study was made of the in-school utilization of "The 
Electric Company" television seties. The findings reported here 
provide feedback to the series' users and producers. As in the first 
year study, the data update infonnation on the technical capabilities 
of schools to use television, on applications of educational televl-^ 
sion, and on the^ att^itudes of students; teachers, school administra-'' 
tors, and the educaMpflally involved public toward television as an 
instructional mediiiS, The data are based largely on information pro- 
vided by sample surveys of elen^ntary school principals and teachers 
who were questioned nationwide during the 1972-73 school year. Three 
mailed surveys were involved. The results of the surveys showed that 
_in-school utilization e^anded considerably in xm^st areas\ of the 
%ation> with the series being used by an increasingly divSarsif led 
range of schoofs. Sotc but not all of this expansion was \iue to ^ 
improvements in the technical calpabilities of schools. At Vhe s^me 
time, pupil viewing patterns shifted soiaewhat to give even greater 
exposure to slow reading target pupils:, and to provide i|8re selective 
usa of the series for a limited number of grade levels in an adopter 
school, llural and private schools have gradually achieved utiliza- 
tion rinj/ls equal to urban schools* 



Litman, George H. CAT in Chicago . Faper presented at the annual convene- 
rtion of the Association for Educational Data Systems, 1973.. 3p. ED 087 423. 

A computer-assisted instructional system has been implemented in 21 
elementary schools in Chicago. ^ The system runs ori a Univac 418-III 
computer wiiich processes cpncurrei^tly the reading, language arts, and 
mathematics drill and practice strand progran^ of the Computer Curricu- 
lum Corporation. All students participating qualified under the, 
elementary and secondary education act Title X Guidelines'^ for Compensa- 
tory Education and all were achieving at least 'oqe year below grade 
level , upon entering the program. Results of the proj«^t after the 
first year showed it to have be^ highly successful. Individualized 
in^rtructloa^was provided, and teachers were freed f rom xirill activities 
for more creative work. Most impprtantly , students showed gains to 
nearly one month for each month in the program, a figure substantially 
better than the national average for compensatory education students, 
which stood at 5.6 months for every 8 months of instruction. As a 
consequence, further expansion of th#*program to 11 new schools was 
planned for the following year, ^ 

/ ■ 
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Longo, Alexander A. A Summ^tive Evaluation of Computer Assisted, Instruction 
in US Array Basic Electronics Training. Technical Report^ Anny Signal Center 
and School, Fort* Monmouth, NJ, 1972. 57p. Available from National Technical 
Information Service, Springfield, VA 221^1 (AD-749 470). ED 074 69,9.* 

Presented in this report is an extension of the feasibility and 
follow-up studies on computer-assisted instruction (CAI) in the US 
Anny*s basic electronic training course. The report is oriented 
toward" demonstrating the variability of CAI coping with a lai'ge 
block (102 hours) of material uhder real-time training conditions. 
This evaluation Is a comparative analysis of the effectiveness of 
CAI as a teaching system relative to tlie conventional mode of instruc-. 
tlon. Included in the study are ,data on student achievement and 
attitudes toward CAI. 

Longo ^ Alexander A^^^and Giunti, Frank E. , A Sequential Evaluation of Computer 
Assisted Instruction m US Army Basic Electronics Training . P^per presented 
at the annual convention of the Association for the Development of Instruc- 
tional Systems, 1972. 17p. ED 082 '472. 

V 

■ \ 

The computer assisted instruction (CAI) division of the US Army 
•Signal Center and School (USASCS) at Fort Monmouth evaluated ^ CAI 's 
success in teaching basic electronics. An initial feasibility study. 
Interim assessments, and a summatlve evaluation assessed the value of 
the developmental, user-oriented. Individualized CAI ^^rograms ci^eated . 
by'^ tlfe,HJSASCS. The CAI mate^rlal was presented in the tutorial mode on 
tbe tBM^-iSOO system, utilizing the IBM coursewrltet language, an IBM 
1510 display console, and an IBM 1512 image projector, CAI and con- 
ventional instruction were compared with respect to student ..achieve-- 
ment in the first four weeks of the electronics course and their 
achievement In the fifth and sixth weeks; attitudes toward CAI were 
alsp " assessed. A matched group statistical design was employed^, and ^ 
^^fixed effects analysis of variance and T-tests for equivalent groups 
used to analyze ' data. The results indicated that CAI is as effective 
as, or better than, conventional instruction in teachin;g bas^c elec- 
tronics, demonstrated CAI ^ s capability to reduce training time by 35 
percent, and revealed ' student satisfaction with the CAI methods. 
These 'favorable findings have contributed to the recommendation that 
the Artiry' continue to expand its CAI capabilities, 

Lysiak, Fae and others. Compu ter Assisted Instruction 1975-76 Evaluation 
R eport, A ti tle I Program, Revised . Fort Worth Independent School Dis- 
trict, TX, DepartmerTt of Research and Evaluation, 1976.' lOlp, ' ED 140 495.** 

The computer assisted instruction (CAI) program studied was Imple- 
mented in eight elementary and four middle schools. The drill and 
prac t ice program foe used reading and mathemat ics skills using a 
computerized curriculum developed by the CoTnpute.r Curriculum Corpora- 
tion, Students in grades 3-7 qualifying under Title I guidelines 
were provided with ten minutes of practice daily. The weight of the 
data supports CAI. Students made 'a^t least a month gain per month of 
instruction on th^ computer 'curricu la ; middle school CAI students 
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made slgnlfieatttly^ higher standardized test gains than did non-CAI 

students. Both CAI and control programs w«re ^ually effective in, 

achiWing reading gains* Elementary mathematies gains generally 

favored CAX students* Elesfientary teacher responses to questionnaires ^ 1 

indicated that the teachers perceive CAI as beneficial, to student 

achleyetaent; middle school teachers were less positive but still 

moderately supportive. Student responses to questionnaires Indicated 

that they perceived CAI drill and practice as personally beneficial 

and as an enjoyable activity, . ^ ^ 

' • . ' • ■ . • * ' - 

Mack,IHerschel and Littlejohn, Stephen.^ PSI as an Approach to the Te&ching 
of EmAirical Research Methods . Paper presented at the annual meeting of 
the S|eech Contounication Association, 1977. 34p. 149 408/ 

This paper describes a field study of the ''Personalized System of 
1 Instruction" (PSI) as^lt was us^d in an undergraduate communications 
' research course. On the basis of statistics from two years of the 
j program's implementation and from student responses after completing 
the course, the Stiudy draws five conclusions. (1) Most students did 
not make optimal progress in passing the sequential unit mastery tests. 
, (2) Most students found that they had difficulty in understanding or 
remembering course material, even in the self-"pa«^ format. (3) The 
P^I approach produced a lower grade distribution than did the tradi- 
tional lecture-discussion method. (4) Many of the students were not 
satisfied with the PSI approach and considered that no significant 
learning had taken place. (5) Although some students seemed to lea^n 
well ^nd were satisfied with the PSI method, the instructors could 
not tell if it was the method that helped or if these were merely 
good students.. The paper concludes that PSI has many advantages as 
4an instructional method but must be carefully adapted to fit the 
^ needs of particular teaching situations or course objectives. 

■ ■ ■ ■ ' < 

Martin, Thomas H^|||^ others. A Policy Assessment of Priorities and Func- 
tional Needs for The Military Computer-Assisted Instruction Terminal .. * ^ ^ 
University of Southern California ,^ Los Angeles t Annenberg School of Communi- 
cations; University of Southern .Calif omia, Marina , Del Rey, Information 
Sciences Institute, 1975. 108p. ED 116 672. 

A policy study was conducted in four rounds to assess the anticipated 
.payoff of investment by the Advanced Research Projects Office in the 
development of a new family o^ temjifaals tor use by the military in 
computer-assisted instruction. Members of the panel of experts pro- 
posed features, rated them, and reacted to th^ resulting ratings. 
Of the 24 features, those rated as most needed were seen by these 
experts as likely to be in commercial production five to ten years 
from now in a form usable by the military. Experts generally agreed 
that Investments in innovative pedagogical software ancf in innovative 
course writing are likely to have greater payoff than an investment 
in terminal development. Of 14 software features, those rated as most 
needed were ones for particularizing instruction online to the course- 
related needs of individual students. The report is a thorough descrip^ 
tion of the conduct of the study^* 
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Matthews. Bonaye L. Training More Emplpyees for Less Money, Training and 
DeveXoptnent Journal v31, nlO, p42-46. Oct 1977. EJ 167 245."' ^ " 

Provides job-st^ills needed by a PACT (Programmed Audio Cassette 
Training) course writer,, a PACT course .development flow chart, 
example frames and script, and discusses objectives and an evalu- 
ation of a PACT course. ^ 

■ ■ . V / 

Mays, Luberta and others. An Evaluation Report on Vegetable' Soup • The 
Effects of a Multi-Ethnic Children' s Television Series on Intercr oun Atf:^- 
tudes o f Children. Precis and Overview . New York yH„..^7^^^<.'^| perirt 

ment, Albany, Bureau of Mass Communications, 1975. 47p. ED 120 204. 

This report, presents the summative evaluation of Vegetable Soup, a 
multi-ethnic children's television series designed to reduce and/or ^ 
eliminate. the adverse effects of racial isolation in elementary 
school students of white, black, Asian, Puerto Rican, Chicano, and 
Native American backgrounds. It was the purpose of. the research to 
test the predetermined objectives of the programs in order to assess 
... the effect of the programs in bringing about attltudinal change on the 
part of those children who viewed them, compared with those children 
who did not. ^ Data were collected by three methods: recording verbal 
; 'responses as children viewed programs, analyzing verbal responses in 
; ^terras of educational gains, and administering a formal test by using 
",f -'- <fP interview technique. Positive verbal tesponses, attainment of 
^-t ./.objectives, and significant difference, in intergroup attitudes of 
''■'J'i ,T^i«wers compared to non-viewers were strong indfcators of program 

series had an effect on all children who viewed 
'^^^^ ' some of the measures showed greater gains for some 
• ' ■chil<jken, particularly in the areas of acceptance or rejection of 

others. Spontaneous responses generally indicated feelings of warmth, 
understanding, sympathy, and empathy for children of other ethnic 
groups. 

McGuigan, F. J. and others. ' A National Field-Test of Selected ProRrammed' 
Reading Materials for Undereducated Adults. .Center Research Monograph N o. 3 
North Carolina State University, Raleigh, Adult Learning Center, 1972.'' 161p 
Available from the Adult Learning Center, f. 0. Box 5096, North Car 
State University at Raleigh, Raleigh, NC 27607. ED 109 594. 
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In the summer of 1971, the Adult Learning Center decided to conduct 
a one-year, research-based field test of programmed instructional 
materials specifically designed to teach disadvantaged adults to read. 
The four programs tested for effectiveness were Programmed Reading for 
Adults, Building Reading Power, Rea^Ung SerieJ^ and Building Your 
Language Power. An attempt was made ' to assessHhe effectiveness of 
each program as a function of such student characteristics as intelli- 
gence, degrec> of motivation to study, ethnic group, and whether English 
was the student's first language. Additionally, students and proctors 
were asked to evaluate the program each used. The general impression 
gained from' examining the learning data--the primary criterion used--is 
•that none of the programs was positively evaluated on ail measures. 
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However, the use of Building Reading Power and PTograwned Reading 
for Adults leads to ^ satisfactory ^«»ount of learning. On the 
criteria of stu4ei5it evaluations, proctor evaluatdons, and error 
ratings, only Prograuaaed Reading for Adults flwix be judged to be a 
successful program. Complete testing data and-^detailed descriptions 
of the study design, results, and conclusions are included in the 
document. 

McKeown, James PLATO Instruction for Elementary Accounting . Illinois 
University, Urbana, Coraputer-^Based Education Laboratory, 1974. 25p. 
ED 123 467. / . : 

A progress report of a study using computer assisted instruction 
(CAI) materials for an elementary course in accounting' principles 
is presented. The study was based on the following objectives: 
(1) improvement of instruction in the elementary accounting sequence, 
and (2) help for transfer students from 2-year institutions. The 
materials under development are part of the progransned logic for 
Automatic Teaching Operation IV System (PLATO IV), One feature of 
the system which is extensively' used in the accounting materials is 
provision for the student to enter arithmetic or algebraic expressions 
as a response to a question. The expression can then be evaluated and 
the result compared to the correct answer. This feature allows the 
student to concentrate on the method of ^lution. The advantages and 
potential disadvantages of the CAI^system are discussed. Twenty-six 
lessons were* developed for the first semester and 17 for the second 
semester of a course in financial accounting, 'and the;^r testing and 
implementation are described. Examination results and an analysis of 
student time and completion of homework revealed significant differ- 
ences in favor of the PLATO IV instruction. 

Media Implementation through Teamed Supervision. Evaluation: :^tle Three ;. 
ESEA . Boardman Local School District, Youngstown, OH, 1969. 6.1p. Availa^ 
ble from Boardman Local School District, 7410 Market St., Boardman, OH 
44512. ED 049 598.* " 

The procedures and techniques developed to evaluatfe a project to imple- 
ment media in elementary schools are discussed. To describe the 
decision-making setting, two necessary conditions — understanding (high 
or low) and amount of Change (large or small)— were paired argainst 
each other, resulting in four possible evaluation settings. The 
situation In question was determined to be like the ^'neomobilism" ^ 
setting characterized by large change and low understanding. Four 
types of decisions are considered in the evaluation: planning, struc- 
turing, implementing, and recycling. By matching the decision structure 
with the setting, a logic ttyr the evaluation design is worked out which 
is translated into a 23-step PERT network. Eight means of collecting 
data were identified and modified, including th^ McLaughton Instrument 
for Communication Examination, the Oklahoma Self-Administering Media 
Evaluation Test, and teacher evaluation reports. A computer data 
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«anageaent prpgram was developed for manipulation of the input -data. ' 
The results are discussed in generalized (non-statistical) terms in 
relation to the project"* objectives. Jone of the necessary condi- ' 
tions for adapting this model to other -projects are suggested. 

• * 

tationVn,"'''^!;^ Studies in Continuing Education for Rehabili - 

tlt^gS ^nselors Report No. 3, Orrober_1971. Iowa University. Iowa City.' 
tlSf ce-'s^a ''I'' /c'- ^^-i^^^rom National Technical Info^;. 
21?634 ED lsfLo Springfield, VA 22l5i, Order No. PQ- 

An experiment (January-December 1969) , applying a' packaged learning, 
program consisting of 30 Individual units on a variety of subjects In 
a voluntary- continuing eduWion program in state rehabilitation 
agencies, demonstrated significantly increased information about the 
counseling job among those (^unselors who actually took one or more 
units an'd indicated differential effectiveness of the units': with 17 
associated with signif icantlyXhigher gains in kndwledge. Individual 
motivation to take the units. Wever, was not high. ?wo other experi- 
ments (June-December 1970) with\different types of specially developed . 
learning packages were also reporte^. Appendices detail research ' 
materials; 39 references are listed.\ • 

?^^4liEn^il^^ i^SP.) interitn Evaluation Rpp or^■ V 

:/c.^"^" 7~-^-^- ^^^i^^vllle R-3 S chool District. MO; Northea st \ 
Missouri State University, KirksVllle. 1973. 57p. ED^ 093 895. ^ 

'^r^ilAH^''^'^ evaluation of the Missouri Environmental Studies Approach ^ 
(MLSA) for a one-year period measured attainment of three objectives 
. ^'^V'ex'^''' participating teachers will use environmental ' 

studies (ES) materials in their teaching as a result of two intensive 
workshops during the summer of 1972; (B) the teacher's role^will 
. change so that students will take more responsibility for learning 
.,and the teacher will tend to use the open classroom approach; %nd 
(C). students will learn to use the total environment as resource 
material. Th^ first objective, which was measured ^y the number of 
^ nssignments teachers gave directly from.'or modeled on, ES materials 

was attained. The second objective was evaluated by an outside 
_ consultant who- reported that teachers' roles had indeed changed as 
n result of implementation of the environmental studies approach. 
I he third objective was measured by two tests: the "About Me Test" * 
and the "Positive-Negative Adjective List." The results of both of 
_ these tests showed that children's self-concept and self-esteem were 
improved. A national evaluator of the ES approach commented that MESA 
project results were more pronounced than the national results which 
showed that students using ES learned more content pertaining to 
environment than control students and that ES materials fostered more 
decision making on the part of both students and teachers and helped 
Co improve students' self-image. 
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Mitzel, Harord E; an<J* others- A Comaonvealth Gonsortimn to Develop, 
Implement and Evaluate a Pilot Program of 'CompQter; ; ^Aasistfed Instruction * 
for Urban" High Schools^ Final Report , Pittsburgh tJhiyersity, PA, 
School of Education, 1971., 213p. ED 059 604. >: > ^ 

The school districts of Pittsburgh and Philadelphia, the Dep^Vtment . 
of Education of the Coaanonwealth of Pennsylvania, and Pennsylvania 
State University formed the Co||puter*-Assis ted Instruction Consortium 
to develop and evaluate two high school mathematics programs 
utilizing the medium of cwnputer-asslsted instnzc,tion. The first 
18 months of the prgject (until fall of 1969) was st)ent in curricu- 
lum development activities, A full-year trial of the materials 
provided feedback for ^course revision and blocking of exercises into 
units. During the School year 1970-71 'the Consortium worked on 
a major evaluation effort, dissemination activities, and polishing 
the curriculum materials in general mathematics and algebra. ^The 
predominfiint theme for the curriculum was teacher-monitored independ-^ 
ent study for each student. Two main types of material composed |, 
the individual study curriculum: an online or computer-mediated | • 
component involving student/cohtent interaction at the computer 
terminal and an off--line component consisting of self-study . in a i 
variety of modes, such as workbooks, filmstrips, puzzles, games, and' 
textbooks. Both the general ^piathematics and the ^algebra material were 
designed to appeal to urban youth.. The course development , summatlve 
evaluation, and a cost analysis of the system are presented along ' 
with summaries of the courses and the nlaterials prepared for them.^ 

Mock, Ronald L, and others,- Northern California Postgraduate Medical Tele- 
vision: An Evaluation, Journal of Medical Education v45, nl, p40-46. Jan 
1970, EJ 015 978. 

Evaluation of several levels of northern California' s' post-graduate 
medical televis^ion indicates that neither the information level nor 
the behavior of target audiences were affected by the prpgrams. More 
^--"''^^initive approaches to evaluation were proposed. 

V 

Modern Consumer Education. Consumer Education Materials, Educational Product 
Report: ♦ Number 37 v5, nl, p6-18. O.ct 1971, EJ 046 804. 

Ac cent /Consumer Education Series. Consumer Education Materials, 
Educational Product Report: Number 37 v5, nl, pl9-3U Oct 1971. 
EJ 046 805. . 

Consumer Mathematics^ Consumer Education Materials, Educational 
Product Report: Number 37 v5, nl, p32-40. Oct 1971. EJ 046 806. 
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Teaching Consumer Educat;ion. Cdnsumer Educatipn Materials, 
Educational Prpduct Report; Number 37 V5. ni, p41-5i. Oct 1971. 
EJ 046 807. • 

These comprehensive In depth reports on instructional materials 
prograimAed packa^;es provide selection data for school systenss ^ 
b^sed on myltiple criteria assessing instructional processes 
and content, difficulty of implementation, and ease of 
incorporation i,nto an ongoing curriculum design^ 

An Epielogue,. Consumer Education^ Materials, Educational Product 
RepQrt; Number 37 v5, nl, p52-55. Oct 1971. EJ 046 808. ' 

An analysis of four ins true tioi^il^HjCka|es as possible additions 
to an ongoing educational program, and possible consequences of 
their adoption and use in a variety^f curriculums. 



rtoeffch. Laurel. The Effectiveness of an Individually-Organized Computerr • 
Managed Program (PLAN) with Educ^tioiTally Disadvantaged Students in Middle - 
Elementary Grade Mathemalics - Ph.D. Dissertation, National College and 
Graduate ..School, 1975. leSp. ED 121 874. ' * . . 

-The Program for Learning in Accordance with Needs- (PLAN)^ is character- 
ized by a completely individualized pattern of organization. It' 

' employs multiple textbooks and 'materials which ci^oss grade ' level lines , 
subject mattef area lines, arid teacher-pupil lines. It places emphasis 
on a high concentration of modern mathematics content. The" computer 
performs four major' managerial 'functions, i.e., test scoring, diagnosi-s, 
prescribing, and repSrting. Traditional or non-PLAN schools follow 
a class-as-a-whole or team teacl^ing arrangement in which a, single 
textbook series is followed according to prescribed grade level lines 
with standardized concentration on modern mathematics con-tent. Ferfor- 
man<:e difference between'; PLAN and non-PLAN middle elementary grade 
mathematics students were . analyzed on the basis of results* obtained 
in the Otis Lennon Inrelligence Test and the Metropolitan 1970 Standard 
Achievement Test, Intermediate "Battery The sample was drawn from a 
single district of a highly mobile, educationally disadvant^iged popu- 
lation in a nortiiorn Illinois city during the 197-2-73 school year. . 
Ovet;alI, the non-PlJ^N schools did as well or better than the PLAN 
schools. This may have' been due'to the high percentages of minority 
students', hi^h percentages of low IQ students, and high student mobility 
in PIAN schools. . , ' 



158 



ERIC 



Mohrmann, Jeanne W/ and Wise, Wilmer E. Evaluation of Closed Circuit 
Educational Television in Delaware; Emphasis on Utilization, Progragi 
Series Content, and Commitment, Preliminary. Report > Delaware Stat6 
Department of Public Instruction, Dover, Division of Research, Planning, 
and Evaluation, 1970. 264p, ED 038 033., ' ^ 

, The basic aim of this study was to deteraine the effectiveness of 
closed circuit educational television in Delaware public elementary 
and secondary schools. At the time of the study, the budget fpr 
educational television in the state had been eliminated. The major 
points for review were -program scheduling -and selection, utilization 
of program series televised between September 15 and NovOTber 19, 
analysis of program series content, and ttxe extent of locaL district 
commitment. Four groups were studied — teachers, principals, other 
administrators, and pUpils. Data were gathiered by questionnaires 

\ and interviews. The f indings "were analyzed and the results are \ 
presented and discussed.,,. A bibliography is provided. Appended to ' ' 
the report are a Collection . of * background information on the research . 
methodology of the study, and tabulated questionnaires. 

Moodie, Allan G, An Evaluatton ,of t;he '^Drugs Are Like That'^ Program . 
Vancoifver Board of SchAol Trustees^ British Columbia,; Department of Planning 
and Evaluation, 1972. 27p: Ep/p77: 951- 

The purpose of this study Ts- .to assess in selected Vancouver elementary 
schools the drug education :t>rogram utilising the film "Drugs Are Like 
That.^* Questionnaire responses are sumpiarized for ' (1") parents i^ho 
attended the advanced showings of the film^with the subsequent discus- 
sions on drug abuse, and (2) principals, teachers, counsellors, nurses, 
and Junior League volunteer's who assisted with the drug education pro- 
gram for grades 4-7 at seven elementary schools. Analysis of responses 
showed that: (1) the majority of parents and resource personnel gave a 
"good" rating to the film, the evening program, classroom discussion, 
and the kit of drug information booklets; (2) most parents ,and resource 
personnel Indicated that the film was suitable primarily for grade 4 ' . 
and secondarily for grade 5; and (3) both groups agreed overwhelmingly 
w that schools should share with parents the drug education of children • 

^ \ 

Morgan, Virginia Richardson. A Cost Study Analysis of Measured Gains in a 
Reading Pro gram Utilizing Indivi dualiza tion o f Instructio n^ Ph,D. Disserta- 
tix)nr Florida State University, 1974. 92f^ ED 103- 534. 

The problems stated for this study were: (1) to detennine the addi- 
tional cost per month of reading gain in the Dougherty County Reading 
Program — funded under Title I of the 1965 Elementary Secondary Educa- 
tion Act — for elementary students (grades 1-6); (3i to compare the 
previpus cost per month of ^ain fpr students enrolled in the Title I 
program with cost per month of gain in innovative reading activities; 
and .(3) to determine the rate of increase in reading growth which may 
bp attributed to thg Title I progr.m in Dougherty County, GA, 1973-74. 
Subjects included 1,1.20 students in 12 elementary bchools in Dougherty 
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who were enrolled in a Title I reading project utilizing the center , 
concept and individually prescribed instruction with 13 teachers and 
13 aides. " Since these students were pulled from the. bottom of the 
lowest academic strata there was no control group availaljle for com- 
parison;' therefore, history of previous gain as calculated from the 
pretest means-was used as a basis for determination qf difference. 
Teachers weare trained and supervised throughout the school y^ar in 
both reading skills and .management techniques. All data indicated 
significant improvement in the l^atio of reading gains for all grade 
levels. It was concluded that it cost less to teach better wh'fen cost 
is based on amount of reading gain per dollar expenditure. 



Moriber, George. The Effects of Prbgraxmned ^Instruction in a Cellege Physical 
Science Course for Nonscience Students, Journal of Research in Science Teat:h -- 
' lng.v6, n3, p214«21^. 1969. EJ 013 595. 

Describes procedures, results, and conclusions, of a s^udy designed to 
compare the effectiveness of a 3-week programmed unit "in atomic theox*y 
/and chemical bonding for nonscience students with, a- conventional lecture- 
I . demonstration Method of instruction. The unlV and evaluation instruments 
[ • were author-*construc ted . 'The study involved 240 students. Immediate 
I gains *fav6red students using programs, Th^re was no significant differ- 

ence in retention. A bibliography is included. " - 

Murphy, Richard T. and Appel, Lola Rhea. Ew^iluation^of the PLATO IV Computer - 
Based Education System in the Coinraunity College, Final Report. Educational 
Testing Service, Princeton, NJ, 1977. 446p. ED U6 235. 

PLATO IV (Programmed. Lo^ic for Automatic Teaching Operations) is the 
fourth ge^ration of a computer^assisted^ instructional system developed 
'at the University of Illinois.- The u^e of PLATO IV at five community 
colleges, and an evaluation of its educational impact on participating 
students. Instructors, and colleges are described. The PLATO system ■ 
, * was found to be operating essentially as planned by its developers. 

The systefti provided a medium for instruction with substantial appeal 
to both students and instructors, but it had no consistent positive or 
negative effects on student achievement or attrition, Ttie coopera-. 
tive effort between ins true tors and developers was successful in that 
a substantial number of PLATO lessons were designed, developed and*. 
Intep,rated into origoing community college courses in the five targetW 
subj^^ct areas: acrcounting, blvOlogy, cheijiistry, English, and mathc- 
n^atirs. The usage of PLATO by Xtudents . and instructors exceeded . 
initial cxpectal ions although th^cxtent of usage in classes was ^some- 
what less on the average than had been proj ected originally. Accord- 
in'^ lo tho evaluators, the critical factor which accounted for the * 
high acceptance and usage of PLATO was the control that instructors : 
had ovor il's uf^v. The attitude surveys and tabulated results , are 
appended. 
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Nolan* Jeanne and Gross, John. Mulligan^ -Stew: Aii Evaluation of the 
Television Series . Missouri -University, Coluiri±>4a, Extension Education 
.Department, 1975. 23p, ED 105 889. 

i . ' • . ■ • ■ 

To evaluate the effects of the ptiblio- television series on nutrition 
Mulligan Stew, a survey was conducted of 4,332 fourth, fifth and 
sixth-grade stude^^its in four areas of Missouri. Children were 
asked/if they had voluntarily watched the program and pre-- and 
post-tested for nutr^-tion knowledge. Comparisons were also made 
between teacher-reinforced lessons and no ^ reinforcement , and 
^ children were questioned whether they believed additional programs 
would be helpful. Results siiowed that a large percentage of 
Children watched the show at home ^ but a smaller percentage watched 
all six programs. Children who watched the program at school 
scored higher in post-test nutrition knowledge; girls scored higher 
than boys, and fourth and sixth graders high^i: than fifth. Teacher 
reinforcement significantly increased nutrition knowledge, , Both 
teachers and students evaluated the series positively. Appendices 
include summaries of the six programs in the series, and the student 
questionnaire. 

O^Bryan, K.C. Monkey Baris Research Report. Report No. 46 . Ontario 
Educational Communications Authority, Toronto, Research and Planning"^ 
Branch, 1974-^ 84p- Available from Qntai^ Coixanunications Authority 
Publications, PO Box 19, Station R, Toronto, Ontario M46 323, Canada. 
ED 098 974-** ' * , 

k study of 64 Canadian^- to 12--year"olds and of adults who might 
influence their television viewing habits was iMde ta measure 
/\the receptivity and acceptability of "Monkey Bars,** a children's 
television program created as an alternative for Saturday? morning 
viewing. A 50-mlnute composite tape of program segments was shown, 
after which observation shee^ , questionnaires , and interviews 
were used to learn children's character preferences, ability to 
grasp the educational concepts, attention span, and scheduling 
preferences- Ninety-Height percent of 7-^ to 9-year-'olds and' 84 
percent of 10- to 12-year-olds said they enjoyed the program and 
75 percent would watch it if offered for home viewing. Adults were 
evenly divided when asked if they would reconnnend **Monkey Bars*' 
to children. Two-- thirds of the 7- to 9-year-olds preferred a 
Saturday morning viewing time, while 10- to 12^year^olds preferred 
ifternoon. Results showed that younger children overall enjoyed 
the program, but were not able to grasp all its huinor, as older 
children could. Appendices include the original observation sheets, 
questionnaires, and Interview schedules. 



0' Bryan, K,G, and others. Q uest Into N a tter , Final R eports Ontario 
Educational Coimimn Icat ions Authority, Toronto, Research and Planning 
Branch, 1975. 25p. ED 116 690, 

"Quest into Matter,'* produced by' Ontario (Canada) instruct ional 
television, aimed to Investigate the ^*heart of matter" at the 
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college freshman level of chemistry. Specifically, its purpose was 
to detnonstrate the relevance of "shape'* in relation to the properties 
of matter from the mole.cylar level' to the galactic. Some 180 
students enrolled in a first year chemistry course and 17 freshman 
chemistry teachers took part in the evaluation of the program^ which 
Involved responding to a set of questions after viewing the program. 
The students found the programs stimulating, informative, and 
neither boring nor confusing/ Most found the analogies in the 
program very or somewhat helpful in understanding the various 
properties of matter and very or somewhat relevant to their chemistry 
course. Teachers responded even more favorably than students. Over 
90 percent found the program somewhat to very stimulating and 
neitjier boring nor confusing. Most teachers also found it very 
informative. Like the students, the teachers fpimd the analogies 
very or somewhat helpful in understanding the various properti'^s of 
matter and very or somewhat relevant to a first .year chemistry 
course. They also preferred a combination of both the method used 
in the program and a conventional lecture-type method and stated 
they would like to see more programs of this type used in their 
classes. The findings suggest that programs like /'Quest into >^ 
Matter** would be readily welcomed as supplementary material to 
textbook information. 



O'Keefe, Ruth Ann. ' Reports on the STARTER/101 Pilot Project in the Read - 
ing Center of the D.C. Public Schools . Washington School of Ps;^£hiatry, 
Washington, DC, 1970. 34p . ED 045 316./ 




Eight reading specialists and seven classroQ»Hieachers in Washington, 
ac, taught the STARTER/.lOl Reading Program to 98 elementary school 
children in 1969-70. The children were chosen because they had 
experienced considerable difficulty in learning to 'read. The pro^ 

gram^ designed as a beginning reading program for urban childrpn, 
consists of workbooks promoting individual work with the occasional 
help of it reader (teacher, tutor, etc.) and can be used with indi-- 
viduals or with groups. Results of this study showed mean gains of 
6.6 months on^fthe Wide Range Achievement Test and similar gains on 
the Botel Word Opposltes Test, on the infonnal reading inventory 
(Sheldon Series), and on the Illinois Test of Psycholinguistic 
Abilities^ Auditory Association sub test . Ileports of teachers and 
'childrtm were favorable, indicating the effectiveness and the 
cippropriateneHS of STARTER/lOl. Recomniendat ions were made for 
extension and further study of the program. Tables are included,. 



0 1 i e n , C . N , and others. A Systems Ev aluat 1 o n of a P urpo sive M ess age : 
The " Mu 1 1 i^g^a n S t ew^ ' KT V P roj ect . 1975. 1 11 p\ ED 1 -2 2 7 9 4 . 

The MulHp^an Stow television series on nutritional principles for 
elementary srhool students was evaluated using a systems model. 
The study includ^'d student responses in eight schools and evaluation 
of re55ponHt\s f roin nutrition spec i a 1 i s t , ' inf ormat ion specialists, 
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television station personnel, and teachers • Agricultural college 
information specialirsta gave the'most optimistic responses, and the 
most accifrate estimates of audienc^ reaction came from television 
station personnel. The greatest knovledge gain came in schools \ 
that used video tapes and in-class exercises together. Learning 
appeared to be a consequence of organized concentration on the 
, concepts in a school setting. Further, this , concentration was an 
outcome of an organized system that produced and delivered the 
series as a package to broadcast stations and schools. The results 
of this* study generally support a systems model of information con- 
trol for evaluating educational television programs .. 

One Nation, Indivisible? A Summary of Evaluation Findings. Education 
Development Center, Inc., Newton, MA, 1969, 56p. Available from Social 
Studies Curriculum Program, Education Development Center, 15 Mifflin 
Place, Cambridge, MA 02138. ED 045 460.* 

^"^n 1968 a television-abased course of ^tudy on racial' conflict * was 
used in hundreds of schools nationwide. Five 30-^ainute films were 
shown to students in grades 7-12. Other materials were teacher and 
student manuals, and th^ee teacher training films; the latter showed 
other teachers going through the film-discussion program in real 
situations. More than 4,000 students (18 percent black) in 200 
classrooms in cities and' towns in eight states were pre- and post- 
tested. More data were obtained by 300 student and 20 teactjer 
interviews, 49 classroom observations, and 83 teacher questionnaire 
evaluations of the course. The program was evaluated in terms of 
five general goals: (1) increased awarene^P'of the racial problem; 
(2) increased awareness of the student's own feelings; (3) increased^ 
willingness on both sides to consider thev feelings knd attitudes of 
the other race; (4) less rationalization of r«!e prejudice; and (5) 
more dialogue about the racial ^problem, makingUt a legit ima t e^op ic . 
for cl^sroom study. The statistical analyses are reported in narra- 
tive form. Many implications of this program and others using film 
to stimulate discussion of controversial issues are discussed . 

Owens, Thomas R. and others. Annual Evaluation Report, of the Hawaii ' English 
Pro jec^ for 1968-1969 . Hawaii University, Ho'HqIuIu, Curriculum Center, 1969. 
48p, ED 0*50 121. 

The English project of the UnJ^versity of Hawaii Curriclum Center, 
begun in 1966, has as its objecfeive the production of a tested curric- 
ulum in English for all grades, together with a plan for installing it 
in the Hawaiian schools and disseminating it to other schools. During 
the reporting period covered, evaluation activities were carried out 
according to a specific evaluation model. Data collected durtng the 
evaluation are analyzed, and the results of the analysis are given. 
It is recommeiided that: (1) objectives in the area of self-directed 
learner sklllp be clarified; (2) uiaterials and instructional proce- 
cfures in the literature and language systems be planned to accoTnmodate 
the. seU-diri|cted learners currently in the language skills subprogram; 
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(3) each unit in all three subprograms be reexamined as to, soundness 
and relevance; <43 the student behavior expected upon termination of 
the pri^rams be more clearly defined; (5) new experiments in peer 
tutoring be conducted; and (6) means for providing more systematic . 
and timely information feedback be developed • 



Paden, Donald W. and othets. A Decade of Computer-Assisted Instruction, 
Journal- of Economic Education v9, nl^ pl4-^20. Fall 1^7. EJ 174 487, 

Dbscril^es a computer-assisted instructional course in economics at 
thfe University of Illinois. The course employed the PLATO system, 
vfhich makes use of .a display panelland a typewriter- like keyset 
which enables students to communicate with th<^ computer. Results 
of a study management system indicated that use of the PLATO system 
(^td facilitate learning.- 



Paden, Jon S. How is IGE Doing in the Elementary Schools? A Four-Year 
Si/rvey of IGE Principals , , Institute for Development of Educational 
Activities, Dayton, OH, 1977. 17p. ED 144 221. 

This report summarizes the responses of pi;:incipalA, of elementary 
schools participating in the I/D/E/A Change Prograro to a survey 
questionnaire that focuses on program implementation and selected 
efforts that may be associated with Individually Guided Education 
(ICE). Survey data are presented ft^r the school years 1973-74, 
1974-75, 1975-76, and 1976-77. The number of respondents for each 
year varied from ^a high of 466 in 1973-74 to a low of 294 in 1976-77; 
Che 1976-77 respondents were a selected stratified sample of princi- 
pals dl^awn from the 1,700 elementary schools that have been involved 
with IGE since 1970. The survey questionnaire was the same all .four 
years. The report consists mainly of tables that summarize the 
respondents' answers to questions about how IGE has affected budgets, 
student achievement, student discipline, and general school operations. 

Paliper, Henry, - Th r_ee _E v a 1 u at Report s of Comp uter Ass isted I nstruct io n 

P^^A?.Z^l^l^L"l^-E5.^LL^i^^^^ Paper presented at the Association ^ 

for Educational Data Systems annual convention, 1973. 22p . EI) 087 422. 

Three separate- evaluat ions of ^a computer -ass is Led in.^ truct ional (CAI) 
drill and practice program were conducted. The CAI was provided by 
Lhe Los Angeles County superintendent to 14 districts as a means of. 
improving students' math abilities and to help teachers manage diag- 
nostic and preser i]>t ive information. The California Test of Basic 
Skills (CTBS) and the Califori>ia Arithmetic Test (CAT) were admini- 
stered before and after instruct t'ion to both experimental (i.e., CM) 
and control grotips. In general, the results indicated that: (1) 
tfio nuMH post -test scores for the experimental groups (^xceedeci those 
' of the control groups; (2) a higher pereent.age of exper inienta 1 than 
of control sTudents exceeded t4ieir I'xpected growth rate5; for the 
[)t^riod; and ( l) the .students receiving CAI experleni^ed grc^wth rnfcs 

; 
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substantially beyond normal expectations. Control group students 
performed better on test's of reasoning ability, perhaps because the 
CAI did not stress this skill. Since the program was of TOjderate 
cost, promoted student learning, reduced the teacher Vs remedial 
vork, an4 aided in diagnosis and prescription of student academic 
needs, it was recommended that it be expanded. 



Parker, Reese. The Development and Evaluation of a System for the Design 
of Instructional Plans and Resource Allocation .^ Paper presented at the 
annual meeting of the American Educational Research Association, 1973- 
27p. ED 074 099. 

The development and evaluation of a system for designing ins true tioxxal 
plans and resource patterns for those plans are described. Development 
of the system, which was in three stages, was based on the praise that 
decisions concerning efficient allocation of resoUj|Mk^ and the use of 
resouro^es for effective instruction cannot realistOTfilly be made in 
isolation from one another. Brief descriptions of the conceptual 
and procedural stages of development are given, but the focus is on 
the first formative evaluation 'and revision^of the system. The initial 
version of the unit design component subjected to formative evaluation 
and revision consisted of eight steps: (1) setting the frame of 
reference for planning and checking planning materials; (2) selecting ^ 
and sequencing objectives; (3) assigning objectives to domains of ' 
learning; (4) selecting instructional procedures; (5) formulating an 
instructional strategy; (6) allocating resources; (7) delivering plans 
to administrative and clerical personnel for costing; and (8) removing 
constraints regarding implementation of the instructional strategy. 
Teachers performed these eight steps, and their efforts and resulting 
plans were analyzed to detet:mine whether the procedures were effective 
and all objectives were met, - Revisions were made in the procedures 
based on the analysis. . 

Peer son, Nell. Two American "Studies on Literacy through Television: A 
television Experime^nt in Alabama, Literacy Discussion vl, n3, pl22-129. 
Suimner 1970. EJ 028 469. 

In Alabama, 9& statewid'e television programs were offered using the 
Laubach method and supplementary group discussion. 

Peterson, Betty L. A Comparison between Achievement Gains in Multimedia 
Instruction an d Conventional Lecture' Method of Instruction of Nursing 
^CoiTrses^ at Northern Virginia Community College .- Northern Community 
College, Annandale, 1974. 42p. ED 129 282. 

An evaluation was conducted at Northern Virginia Community College 
to assess the effectiveness of courses in nursing education presented 
in two distinctly different styles: the traditional lecture method; 
and a multimedia approach employing textbooks, audiovisual aids, ^ 
study guide.\^and lectures. Using State Board of Nursing Examination 

/' 
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sctores as a measure, of instructional outcomes, comparisons were 
made which deuKDnstrated that students were equally likely to master 
nursing skills regardless of the mode of instruction* ^is report 
provides background information on the study, outlines* the research 
methodology, reviews relevant literature, analyzes data, and 
summarizes resultsj 

' ! 

Petty, Bruce Alan^ An Evaluation of Selected Instructional fnedia Programs 

in Kansas Colleg^^and Universities^ Kansas State University, Manhattan, 
1972, 84p. ED 070 290, , 

Suspecting that two-year public colleges are more commit: ted to 
iiistructipnal media programs than four-year ins titutions and that 
higher educational institutions in general are lacking in commitment 
to media programs, the author surveyed 34 Kansas colleges and univer-r 
^ sities by using the evaluative checklist for self-evaluaXing an 
educational media program. The data, categorized into a^^x2 block 
design (2-year, 4-year) vs. (public, private), confirmed the hypoth- 
eses. The author recommends higher edug^tion institutions re-- 
evaiuate their commitment to instructibfeal media. 

Phase^ I Report. Economic Analysis Course ^*/ Sterling Institute, Washington, 
DC, Educational Technology Center, 1968. 16p, Available from Educational 
Technology Center/Sterling Institute, The Watergate, 2600 Virginia Ave., 
Washington, DC 20037. ED 073 657.* . Vi-..^ 

The key findings of Phase I relative tQ th<|^Sterling''1tti^(ci tute 
curriculum development model being used in the preparation of a 
multimedia, individualized course in economic analysis for th^ 
United States Naval Academy are presented in this paper. The 
current status (October, 1968) and planned activities of the pro- 
ject are also outlined. ^.The segments of the actual course, the 
behavioral objectives Involved, and various working papers are 
available as ED 073 633 through ED 073 669. The final evaluation 
report cdn be found under ED 043 790, and the model developed for 
designing systems of individualized instruction is I'eported in 
ED 043 791. 

PrelLniinary Tryouts. Economic Analysis Course . Sterling Institute, 
Washington, DC, PMucational Technology Center, 1969. 28p. Available 
from Educational Technology Center/Sterling Institute, The Watergate, 
2600 Virgin^ Ave., Wrfshlngton, DC 20037. ED 073 659 

Preliminary tryouts of the multimedia, individualized course in 
economic analysis prepared for the United States Naval Academy were 
conducted. An i l/u5^^rat ion of how the data collected was used for 
making decisions on matel^i^ls revisions is also included. 
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Validation Report. Economic Analysis Course , Sterling Institute, 
Washington, DC, Educational Technology Center, 1969. 47p, Available 
from Educational Technology Center/Sterling Institute, The Watergate, 
2600 Virginia Ave. , Washington, DC:20037. ED 073 662.* 

A multimedia course in economic analysis was developed and used in 
conjunction with the United States Naval Academy. .(See ED 043 790 
and ED 043 791 for the. final reports of the project evaluation and 
deve-lopment project.) This report describes the prevalldatlon 
trials, the materials validation, and the validation of the opera- 
tional ii|structlonal sySjtem. 



Preliminary Validation Report for Multi-Media Economics Course. 
Economic Analysis Course . Sterling Institute, Washington, DC, 
Educational Technology Center, 1969. 9p. Available from Educa- 
tional Tedhnology Center/Sterling Institute, The Watergate, 2600 
Virginia Ave., Washington, DC 20037. ED 073 663.* 

A multimedia course in economic analysis was developed and used in 
conjunction with the United States Naval Academy (See ED 043 790 
and ED 043 791 for the final reports of the project e\^luation and 
development model.) This report describes the prelimiii/ary findings 
from the analysis of data produced by the validation tryouts. 
Student achievement and stndy^time-taken are a»ong the areas 
discussed. 

Final Validation Report, Economic Analysis Course . Sterling Insti- 
tute, Washington, DC, Educational Technology Center, 1970. 76p. 
Available from Educational Technology Center/Sterling Instjitute, 
The Watergate, 2600 Virginia Ave., N.W., Washington, DC 20037. . 
ED 073 666.* ' . 

The results of the tryouts of a multimedia, individualized course in 
economic analysis are reported. FindingS^^discuased include number of 
objectives learned, mean time required, and the percentage of students 
iittaining various goals. The final evaluation report can be found 
under ED 043, 790, and the model developed for designing systems of 
in<iiyidualized instruction is reported in ED 043 791. 



Pinsky", P^ul D. Ac hievement Monitoring of Individually Paced Instruction . 
Final Report . Sequoia Union High School District, Redwood City, CA, 197 3. 
31p, ED 092 175. 

A study was. conducted to monitor achievement of individually paced 
instruction. The project concentrated on designing - testing procedures 
in group-paced instructional programs to provide, information to 
student, teachers, parents, and administrators, which could be used 
in both a formative and summative evaluation. The three objectives 
of the project were to: (1) adapt the Comprehensive Achievement 
Monitoring (CAM) design for 'an Individually paced program of^ instruc- 
^ tion that contains a series of units through which students "progress 
in sequence; (2) explore the applicability of the computer-assisted 



167 



ERIC 



iijstruction evaluation technique to criterion referenced testing 
(GRT) for individually piiced ln"k£ruction; and (3) field test th^e 
adopted CAM design in a high' ^chdtol' earth science course.^ The 
results showed quite strongly thatXthe students whose learning 
Activities were controilfed the mostyshtowea the greatest gains in, 
achievement levels. Gains were measured fay the CAM tests and by' 
standardized tests given at the beginning and end of the course. 
The results show this population of students is not able to work 
independently with CRT data and direct its own study activities. 
This finding confirms less jfonaal studies completed in previous 
years. 



Piper, Richard M. and Shoemaker, David M. Formative Evaluation of a " 
Kindergarten Music Program Based on Behavioral Objectives, Journal of 
Research in Music Education v21, n2, p;45-152. Sunnier 1973. EJ 081 153. 

The Kindergarten Music Program (KMP) is one of several instructional 
systems currently under developmeijit at the Southwest Regional Labora 
tory for Educational Research and | Development . The purpose of this 
article is to describe the evaluaifion procedure and the concomitant 
results of the first version of tl^e KMP. 

1 

Pre-Kin d erg-ar ten Prescriptive Teaching ^^rogram for Disadvantased Children 
Pre-School Program .1972-73 : End of the IVear EvaluatioiK Fargo Public 
Schools, ND, 1973- 87p'^ ED 091 061. 1 ' 

- ^<Eiie-^asic goal of this program was. to provide individually-tailored 
instruction for more than 70 A-year^old children identified as. havin 
potential learning handicaps* Children selected .for the program 
attended small half-day sessions four times a week. ^ Instruction in 
the areas of language arts, mathematics, science, health, mo tot 
skills, and social skills was given. Students were tested on a pre- 
and post-basis with both a locally devised test and the Stanford 
Binet Intelligence Test. Project participants scored higher on pose 
test assessments than did children in a control group. 

Prog-ram for Learning in Accordance- with Needs: Developmental Phase. 
Evaluating Instructional Systems, Educatio nal Product Report v7, n58, 
pb-22. Jan 1974. F.J 092 656. 

Evaluates PLAN, a computer-managed individualized learning program 
covering language arts, mathematics, science, and social studies for 
grade levels K-12, > 

Radiick, Michael S. <ind O'Reilly, Robert P. Learnin^_f rom ^Television : A 
Te 1 cvis i on Based Ltvi rn i J>j_s_t_e_m a s a C_apab_le_ School Resource . PaVcr ' pr e- 
sented at the American Kducational Research Association annual meeting, 
1976. 33p. KD 129 254. 

*An , ^instruct iona 1 television program, ''Place of Doors," developed by 
the NeW V,yrk State Education Department's Bureau of Educational 
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Cocanunicatlon to teach science, ecology, health, social studies, and 
consumierism to fourth graders was evaluated. The progiram was used to 
provide mainlj^ne rather than supplemetital instruction. Nine hundred 
and one students from nine school districts participated in the 
television-based program for two hours a day for 20 days. Three 
hundred and fifty matched control students were drawn from the ^ same 
districts. Dfita were collec4:ed through criterion-referenced pretests, 
midtests, posttests, and retention tests developed from the cognitive 
objectives of the program. The mean test performance for eijcperimental 
and control groups across test occasions showed greater improvement 
for the experimental groups. Other statistical analyses showed 
reading and pretest scores to be significant ip predicting posttest 
, scores. The science and social studies areas of the program were 
influenced less by reading ability than other content areas. There^ 
was no relation shown between student liking for the program and \ 
student performance. . 

Reeback, Robert T. and Osterreich, Helgi, Progress Report on the Oral 
Language Program . Southwestern Cooperative Educational Laboratory, ^ 
Albuquerque, NM, 1971. llOp. ED 056 578. ' 

The Oral Language Program is a set of instructional materials in 
English as a second languagj^ f or children aged five to seven. It is 
also an instructional system; in addition to 150 lessons for the 
children, there are pupil assessment devices, teacher training 
procedures and materials ,. program evaluation procedures, and installa- 
tion and monitoring procedures. This report sumnxarlzes the progress 
of the Oral Language Program througl^ the various stages of develop- 
ment. It cjoncentrates on the instructional and assessment* components 
for puftils and teacher training, and reports- on program evaluation. 
Installation procedures are not covered. The three' major sections 
of the report ^re a comparison between the Oral 'Language Program and 
its antecedent^ a detailed revi*w of the stages of developmental 
work on the program since 1967, and a report of the most recently 
completed field trials of the program,, i.e. , those conducted in the 
i969^7p school year, . . ' < 

Re search and E valuatio n of Computer-Based Resource Units . State University 
of New York, Buffalo, Educational Research and Development .Complex, 1972'. 
12p. ED 073 589. r 

Evaluated was the impact of computer-based resource units On teacher 
decision making and the teaching/learning process ^by analysi3&t>f 18 
doctoral dissertations, a 1969 analysis of teacher reactions, at\d a 
continuing analysis pf evaluation forms returned by teachers using 
the units (intended for normal and handicapped children) • Among the 
findings of the evaluation process ^ere that th^ resource guides 
help teachers individualize instruction and result in increased plan- 
ning time and more efficient teaching .time • Suggested was the develop 
ment of a computer based resoure^ unii as an inservlce or preservice 
teacher training experience. Summarized were the responses given in 
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' the evaluation forms received from October 1970 t6 July fSJl. A 
bibliography lists 18 ^research studies, 12 related articles/^d 
two books. \. 

Jlockman, Saul and Auh. Taiksup. ^ Formative Evaluation Report of Self Incot " ' 
porated Programs , Agency for Instructional Television; Bloomington, JN^ 1976 
338p, Available from Agency tbr Instructional Television, Box A, Bloomington 
IN 47401. 338p. ED 119 712. ^ ' 

Self Incorporated is a 15-program television/ film series designed to 
stimulate classroom discussion of critical issues and problems of 
early adolescence- Formative evalu/eftion of S^l?\ Incorporated was 
conducted in two phases: pre-prodifction eva^dtipn and extensive 
field tests of eight of the tentatively competed programs. Separate 
evaluations for these eight pjogramsV were^esigiied to provide ipfonna-- . 
tion to production personnel for decisions regarding each projgram. 
Results of the field tests showed that the prograiiis were effective 
with student audiences, and teachers indicated a desire to use mpre 
programs. That some of the more sensitive programs caused teacher 
discomfort suggested the need f or ^-^special preparation of teachers 
before extensiy,e use of the series, " 



Rockman^ Saul' and Atrli , . Taikstip - Nummary of the Formative Eyj^yuation Report 
oj/'^ ^lf Incorporated Programs . Agency for Instructional Television, 
^ooi^ngton, IN, 1976, l7p, Availabl^^ from Agency for Instructional Tele- 
vision, Box A, '.Bloomington; IN 47401.' I7p. ED 119 71^. 

Self Incorporated is a 15-program teli^vision/f ilm series designed to 
stimulate classroom discussion of problems and issues of early 
adolescence. This document provides 'an overall summary of a formative 
evaluation proje.ct and suinmary^r^sults of the evaluations of each of> 
eight programs in the series. 



Roman, Ribhard A. The Word Prol^lein Program: Summative Evaluation . 
Pittsburgh University, PA, Learning Research and Development Center, 1975. * 
•14p. 'ED 113 212. ' " ■ - 

A programed sequence fur teaching students' to solve word problems was 
developed using a combination of the information processing and ^ ^ 
structural variables approaches Students using the sequence proceeded 
individually through rtastery of a sequence of 'object ives . In order to" 
evaluate the program, fourth aiid fifth graders were randomly selected 
from classes; ^the ' remaining students in these classes served as 
control^. All students \^^re given the appropriate level of the 
Stafford Ach ievL^-ment Test as a preti^st. During the 11 weeks that 
experiment ai, suhjr.^cts co^npleted the word problem program, control 
.^uhjercs received, rt^gular mathemaMe's instruction. The computat^ion 
\ and applications" sec t ioi^s gf the Stanford Achievement Test served as 

^ posttc»sts. Both fourth- and fifth-grade experimental ' groups scored - 

higher on their respective applications postt.ests than the comparable'" 
control groups, 
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Romaniukp £• W. A Summatlve Evaluation of the CAi Course "COMPS." ... 
Alberta University,. Edmonton, Division s|f Educational Research Services, 
1978, 18p. ED. 153 604. 

Xlhe COMPS course is a basic introductory computer course taken by 
'fi^t year computer systems students. Eighteen students to^ the 
course with computer assisted instruction (CAI) , while the rest of 
the students took the course in the c&nvention^il classroom setting. 
Although there was x\o difference between the. two groups* mean group 
^performance scopes, the CAI students on the average required only 80 
percent of the time required by the other students to complete the 
course. Other aspects of the course discussed- include examination ^ 
of the mastery model, Mammary of student attitudes, associated costs, 
and the recommendations. ^ 

Ronan, Franklin Delano. A Study of the Effectiveness of a Computer When 
Used as a Teaching and Learning Tool in High School Mathematics . Thesiis, 
School of Education, Michigan University, 1971. 212p. Available from- 
University Microfilms^, 300 North Zeeb Road,* Ann Arbor, MI 48106. ED 072 615* 

Suspecting that computer-assisted mathematics instruction helps / 
students attain a higher level of achievement than noirmal instruiS- 
tion, the author conducted an experiment in two algebra- trigonoi^e try 
classes. Fifty-one "middle ability" students' were divided l^nto two 
groups- The compujber 'group used the computer both as a computational 
and teaching tool and as an experimental tool. The experiment revealed 
that the computer group *had significantly higher achievement level* in ' 
the treatment of exponential functions, logarithms, and^ trigonomet^c 
identities and formulas; the understanding of mathematical concepts 
and skills; and logic and reasoning ability. However, there was no 
significant difference between the groups in problem-solving ability 
or in the application of mathematical concepts. 

Ross, Harvey L. An Evaluation of the Effectiveness of the Allen Teaching 
Machine at the Federal Correctional Institution, Lompoc, California. Final 
Report ■ Human Interaction Research Institute, Los Angeles, 1970. 70p- 
Available from Human Interaction Research Institute, 10889 Wilshire Blvd.^^. 
Suite 610, Los Angeles, CA^ 90024 .^^ ED 043 830. s / 

This study evaluated the use of the, Allen group teaching machines in ' 
a, basic skills program (arithmetic, language arts, General Educational 
ftevelppment: preparation) at a federal correctional institution (FCI). 
dut*bf ';3l7 eligible inmates, 172 enrolled. The evaluator interviewed 
* ix«nateSt teachers, and prison administrators, and collected data for 
cotnparisons ^etween the Lompoc program and other approaches ♦ {Machines 
displayed the special advantage of deflniTig the teacher role as benign 
^and supportive. The teachers, who became primarily observers of the a 
Ij^^rning process and evaluatoors of programing effectiveness , have ' ' 
tended to receive their new role , favorably . The. inmates clearly ^ 
preferred machines for learning facts by rote. Student grade year 
gains ^rangiP^d from .8 (on a 20-hour verbal skills course) to 2.4 (in \ 
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a 13.5-hour r>umber facts cou^e) , with<lan overall- mean gain of 1.4 
grades for 24 hours o"f s'tudy^ Results ■ achieved in the FCI program , 
. seemed to compare favorably with those from other methods. Systematic 
dissemination of the Allen teaching machirte through(^t the Federal ' 
pe^nal-^^ystem was , urged. (Included ai:e educational statistics, special 
reports, quest lonnairee , and estimates of^fcost and personnel needs.) 

RowcU, John and Heidbreder, M. Ann. Educational Media Selection Centers 
\^^llljr^3y^on and Analysis of Current Practices . American Library '■ Assoc i- 
atiort, Chicago, 1971. 177p. Available from American Ubrary Association 
50. East Huron St., Chicago, XL 60611, ED 050 545.* * 

. Pha.^e I of this National Book Committee study surveyed existing 
educational media selection facilities and examined progVams at the 
V -state, regional, and Iqcal levels. Facilities were located and 
^- '.identified,' and -"their" succes,sful compohents were evaluated" by means 
of q?ies.tio,^inaires and on-site visits. This final report contains • 
ah introductory section which summarises the initial study and ^ 
' descr;.bes the need^ which prompted it, the role of the National 
, Book Committee, t*e purpose of Phase I, and the Educational/fledia 
SeLectidn Centers Progralu itself., The major findina^ ar^i^resented 
^tn" more .than. 80 'comprehensive tables, together wLfeh L><fclusions and 
^ recommendations fqr subsequent phases of the pr^rajiT The conclusions 
. * cite the need for'better communication prugramsK^^^^br more adequate 

ftnanc-.ial bases , apd "for less duplication of effort among- the centers, 
especially -in the area of ova Uia ting and selecting media. Some of. 
the arc^^^ndicatt'd for. fur.ther study include budget, cpntent and 
^ balance ofNjicdia colloctioni?, handling of purchases and free media 
in ceri\:ers; ^iijp lay .and/or , citaloging 'of material, and evaluation 
of audiovisual anci print media. Samples "of the forms used to gather 
'data in the. study are appended. 

>' 

Rubin, Martin L. and others. Evaj^ation of t he Experimental CA I Network 

^^""■^ v Na|:iunal Library of Medici ne. n ua 1 Rep o r t . I^fo . 5~ 1 . "Human ' 

Re^ource.<? Re.s.earch Or^vui i t ion , Alexandr ia, VA, 19 fT. 3%7 ED 115 22 5. 

^ . An cv.ili/aL ion was mad^t,' of the Biomedical Computer Assisted Instruc- 
_^ tlon (CAI) Nptwnrk exp_^-r iment , established by the National Library 
•■■•^)f Metlicin^' ,in 19/3 to test_ the feasibility of sharing CAI. learning" 
materials through a riat lonal computer network. The cvaluat ioni was 
designed < to a.s.si.st dec is Lon makor-S in p lann ing future mechatTism 
(or di .St ribut lag biomedical CAT. The study focused on the Ihstitu- 
•tion.s (95 as of Octol^^r 1974) and people who cuse the network and the 
cent ractDTs- who .suppLied the CAI library.' Data sources included cnkv 
studies, ui^er reports, and interview.s with ho.spltal and medical 
.school adrai,ni-';trators, _ i acul ty , U br^yr i atVs', computer laboratory st^ff, - 
and students. .Network usage by program type, by u.ser inst i t^it ion , and 
bv clasij of. user were ana'lyzed. Also analyzed wore the impi^cl of the 
network on "ouTr i-cu^<i , f'ucul ty , ■ s Ludents . libraries, and Hiedia ctMUers 
.1.'; weU> as c hV cus t /Bene f i ts '. " "Phe report -Includes a rosfw of the ' 
p.ir t it- ipant .s^'-in t fie tietwork exper i«ient . 



Ryclunan, David B. and others. Do Structured Reading Programs- Hamper 
Intellejctual Development? Elementary School Journal v77, nl, p71-73. 
Sep 1976. EJ 148 674. 

A study comparing Che effect of the DXSTAR Reading Program and the 
Lippincott Basic Readers on the cognitive and creat^-'ve 'development pf 
136 kindergarten and fl^rst grade children. The majoTAdlf f erence 
between these two approaches is degree of teacher control. Only one 
significant difference was found between the two approaches. 

Sti Aubin, Rayinond. Evaluation gf C.A.I, as Used by Various Handicaps . 
1975. Up. ED 136 775. . 

I 

This paper suimnarizes a project undertaken by South Metropolitan 
Association for Low-Incidence Handicapped (SMA) in 1975 to provide 
handicapped children in the south suburban area of metropolitan 
Chicago with learning ppportunitxes via computer assisted instruc- 
tion. Students exhibiting hearing, visual, mental, or other 
learning disabilities were enrolled in math, reading, or language. * 
ai:ts programs prepared by Computer Curriculum Corporation. Anecdotal 
and objective performance data on 198 students were collected for 
project evaluation. Subjective descriptioryj offered by participating-- 
teachers illustrate students' responses to and interactions witli the 
computer, and their own positive feedback. Graphically presented ^ 
performance data indicate growth by handicapping condition and • tatal 
average in each area. It is suggested that student progress is ' 
correlated with the amount of online exposure to the program. 

SamuelsV Bruce, Coiftp. The First Year of 'Sesame Street: A^ummqry of 
Audience Surveys. Final Report ^ Volume IV of .V Volumes , Children's 
Television Works hopT^I ew Y^rJ^, 1970. 31p; 'ED 0^7 824. ^ 

\ • ^ . . ; • 

Who watched "Sesame Street*' and with what frequency at different 
socioeconomic , levels? \This utilization study provides answers to the 
question by compiUng data from national ratings, special surveys 
commissioned by the Children's Television' Workshop , and unsolicited! 
Independently 'conducted surveys which were brought to the workshop's 
attention. Nine^ projects were reviewed and summarized into a y;^ew- 
ing profile chart. The chart present? information on title and date 
of surve^r, surveyor, purposes of survey, character of sample, si^e of 
sample, -availability on UHF , VHF, and ^cable TV, and percent of pene- ; 
tratioh. The results of the projects showed a highly encouraging ra^P 
of viewing and supported the ne^d for spdcial efforts to promote wid^r 
viewing, especially in low income neighbbrhoodis and in communities 
servecl only by UHF stations . X*"*''^^ 



Sasscer. Monica Flyj^. 1976-77 TICCIT Prolect. Final R.p .r-r Northern 
Virginia Comniunity Spllege, Annandale, 1977. 150p. ED 148 430.** 

Northern Virginia Community College began utilizing a Time-Shared 
^ Interactive Computer-Controlled Information by Television (TICCIT) 
' system in 1974 to present the entire coarse material for English UO 
(College Grammar), Math 06 and 07 (Basic Algebra I and II), portions 
of English III (English ComposiSion) , and Math 182 and 183. Findings 
by the college and the Educational Testing Service (ETS) indicate- 
faculty members who taught in the TICCIT system were released from 

• most preparation and administrative activities and doiild spend more 
time- with the individual student, since tests, teaching inodules, and 
grades were stored In the computer; no significant differences 
appeared in^tudent performance among the TI-CCIT, lecture, and work 
book sections; non-TICCIT faculty were evenly divided in positive/-^ 
negative attitudes toward the system; TICCIT faculty held generally 
positive attitu4£/s; cost analysis findings were inconclusive; and 
futur-e development and usage of TICCIT depends greatly upon faculty 

• interest and awarenes^s. Lengthy appendices present infonnation 
regarding TICCIT Instructional module development, TICCIT authoring 
capability, course revisions, statements and qualifications by 
JICCIT and non-TICCIT faculty, various survey instruments, faculty 
training, and student attitude survey. 

Science Programming and- the Audiences for Public Television; An Evaluation 
g_L.^'Avg Pr ogram in th e NET "Spectrum" Series . National Educational Tele- 
vision, New York, 1969. 85p, ED 034 933, 

Questionnaires returned by science teachers across the country and 
re.action forms completed by selected high school, college, and adult 
learners, were analyzed to judge the Impact of, and acceptance by 
public television audiences, of five, half-hour programs broadcast in ' 
.the "Spectrum" scit^nce series, ptoduced with financial support from 
the National Science Foundation. A general significant knowledge 
gain was achieved by all three groups of learners; science teachers 
and learneps survi-yed reported satisfaction that science programs 
should be brodticast for the general, public and that in addition to ' 
gaining a high rale of acceptance by laymen, the programs encouraged 
and maintained interesr in .science'". The document includes the 
quest loiwia ire, study guides,' selected questionnaire conmients, adult 
sample re.sp^nises on the seismology broadcas?t, and genetics reaction 
forms. One appendix removed because of poor reproducibility. 

^ ^ * 

I ^ 

f 

f^cheier, Klaine and Senter, Donald R. EvaUm ioii_ oj J^earn in^ 1 00: An ' 

.Etinc:_at_i_on_ j'_r;_oj ec_t_ m 6ecmijd'-S^ 1967-68 . ".'"KducaTiona 1 

Developmeiitiil. I.afrorat or i es , Inc., !h7ntTng"t oYi , NY',' 1969'. ""l9p. ' F.D Q44 'i^I. 

. This sLudy compared the ef f ec t ivenes.s of Learning 100 (L-lOO) with 
that of .1 i-cMivent iona I reading program in 'the li^-d f ord -S t uy vesant 
y section of Brooklyn. L-1()0 is a mu 1 t imed t a , ' mu 1 icioda I , multilevel '~ " 
coimiiunicat ion skills systeifi designed for use with underedur ated 



174 



is/ 








adults, out--6f-- school youth, axid potential dropouts^ There were 49 
in the experimental group^ and 47 in the control group; both groups 
met for nine hours per week. All students were given the Metropolitan 
Achievement Test, Reading Intermediate level, after 10 hours of instruc- 
tion, and after 100 and 200 hours. To the extent that the sample is 
representative of the population from which it was drawn and that the 
teacher questionnaires, interviews* ^nd testing instrunients were 
' valid for this population, it appears that significant differences in, 
achievement favoring the L-lOO group were attained. The L-^lOO system 
can be ^successfully managed by teachers who have had little previous 
experience with educational technology; for students, high interest and 
motivation are maintained and positive changes in attitude toward 
learning are exhibited as a result of the interest level of the reading 
selections and the instrumentation inherent in the sys|:em. 

Scheier, Elaine and Senter, Donald R. Evaluation of Learning 100: ABC 
Center, White Plains, NY, January-June 1968 , Educational Developmental 
Laboratories, Inc., Huntington, NY, 1969, 23p, Available from Educational 
Developmental Laboratories, Inc, , 284 Pulaski Rd., Huntington, NY 11744, 
ED 036 718.* 

Learning 100 is a multimedia, multimodal, multilevel communication 
skills system; heavy stress is plaged on filmstrips, tapes, and 
recordings; many of the materials are self-pacing; and a readiness 
stage and six graded levels of instruction have been developed- At 
the White Plains Learning Laboratory Center, Learning 100 was used 
with a group of 64 functionally illiterate adults whose reading levels 
ranged from readiness to fourth grade. Teachers were provided special 
instruction in how to use materials and equipment. At the end of the 
23-^week program, reading gains, as shown on the Stanford Achievement 
Test, were significant; the greater variability on posttest scores 
indicated that the system encourages individual development- The 
> administrator felt that the system was manageable by teachers when 
they had special training; he saw a relationship between student 
achievement and teacher experience. Teachers were pleased with the 
structured systematic approach, high interest; levels maintained, 
adult-oriented materials, varied modes of instruction, and positive 
motivational changes in the students- The students developed indepen- 
dent work habits, increased self ^assurance, /and saw Improvement in 
their own educational growth. 

Selector's Guide for Elementary School/ Junior High School Science Programs, 
KPIE Tleport 77 vlOVi n2, pl«6l. ^ Nov/Dec 1976. EJ 157 022. • --^ 

^ V 

The analyses of ten elementary and five junior high school science 
programs ar# based on searches into' the instructional design of the 
products hy 26 analysts. Instruct io_nal design includes intonl , 
content, methodology, and means of 'evaluation. 
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Shapiro, Bernadetfce Nelson. Comprehension of Television Pro^ranming 
Designed to Encourage- Socially Valued Behavior in Children: Formative 
Reseych on "Sesame Street" Prosrammtns with Social and Affe ctive Goals 
1975. 228p. ED 122 863. ~ ' 



A study assessed chUdren's comprehension of Sesame Street programming 
that is designed to encoUrag^ socially valued behavior and whether 
the .children relate the programming to their own living experiences. 
Material 'relating to four goal areas was tested: (1) entering 
social groups; (2) coping with failure; (3) coping with basic 
emotions; and (4) sex role stereotyping. Some 73 black, white, and 
Spanish-speaking children who were enrolled in Head Start Center^ 
in inner city areas o-f Springfield and Holyoke, MA, were the viewers 
and respondents in the study. In general, the children's comprehension 
of the social goals material was good. About one third of the 
children seemed to be able to answer open-ended questions about 
most of the material without prompting. Another large proportion 
of the children appeared to ^be at least able to recognize the 
correct answers to questions4lurhen they were read lists of multiple 
qhoice alternatives which served as prompts. There were no striking' 
differences In the responses of the male vs. female children or the 
black vs. white children. All of the children were attentive or 
very attentive to the program segments and appeared to enjoy them- 
selves. Although older childreii performed significantly better 
than younger children on some questions, this finding did not occur 
consistently. *■ 




Shapiro, Sydelle Stone and others. An Evaluatio n of the Mulligan Stev 4-H 
Ti^le vision Series for Extensi on Service, USDA, Volume I : Executive 
^.yj^i^J!:- ABT Associates, Inc., Cambridge, MA, 1974. 40p, ED 134 619,' 

Conducted on over 3,000 fourth, fifth, and sixth grade children in 
six states, this study documents changes in nutrit*lon-related 
knowledge and behaviors which can be related to participating in 
the Mulligan Stew television series. This volume contains a summary 
of thc» findings of the study and recommendations. After part i c i- 
paling in' the series, youth demonstrated more knowledge about 
nutrition-related activities, and exhibited a dramatic increase in 
their awareness pf 4-H . The series generated only minimal changes 
in Lhe> nutrition behavior of youth; while those who viewed the- 
series appeared 'to eat, more for breakfast, their selections frpm 
the basic food groups" seemed to remain unchanged. After partici-. 
paling in the series, youth in all three grad"Ss tended to select 
fewer empty calorie items when given free cho^^ce on a menu ci>ntain- 
ing a larg(^ number of foods. As mecisured by reading abilit/, the 
. s(^ri(\s worked well witli both the good stjjj^ent and the poordr 

student, Wfii the .^u^r'ies appeared to effective witli youth in 
all three grades, tu/erail Liie program had a somewhat stronger 
impact on fourtli and fifth graders than it did on sixth grade. 
V.oUtli. Tf)e cemic workbook and viewing s i tuat ion 'a{:)peared to be* 
importpnt variable.^; although at-home viewing was good, in-schooi 
viewirig generated Inrger changes; and while the series worked well 
without the comic^ workbook, Mulligan Stew wijs mo n^o f f ec t i ve with 
* t he c^t^ii Ic . 



1/f) 



ERIC 



Shapiro, Sydellsv Stone and others. An Evaluation of the Mulligan Stew 
4-H Television Series for Extension Service^ USDA, Volume II: Report 
of the Study . A^T Associates, Inc., Cambridge, MA, 1974. 230p; 
ED 134 619. - 

Conducted on over 3^000 fourth, fifth and sixth grade children in 
six states, this study documents changes in nutrition-related know- 
ledge and behaviors which can be related to participating in the 
Mulligan Stew television series. This volume is a detailed elabora- 
tion of the study findings as well as a .description of the study ' 
design, instrumentatian, and procedures. |~The study consisted of 
three general segments: (1) impact evalliation of the series on - 
children; (2) case studies of delivery system and associated cost 
data; and (3) content analysis. The impact evaluation explored the 
hypotheses that, children who viewed the 3eries would exhibit positive 
changes in knowledge about nutrition and changes in nutrition-related 
behaviors and that these children would show an increased amount of 
awareness of and interest in 4-H, Although the impact evaluation 
focused on children, information was also jelicited from their 
teachers. The case studies segment focused -on the distribution 
system associated with' the prbgram, i.e., delivery and costs. While 
the delivery system, organizational arrangements, and associated 
cost data were not critical to the impact study, th^y did serve to 
provide context data for other purposes. A content analysis of th^ 
films was conducted to assess the nutrition information contained 
in the films, the pedagogic approach used, and the production tech- 
niques employed- The three major sections of this volume examine 
each of the aforementioned segments separately. A concluding section 
presents a summary of m^jor findings from each of the evaluation 
segments and recommendations based on these findings. 



An Evaluation of the Mulligan Stew 4-H Television Serieg^'for Extension 
Service, USDA. Volume' III: Case Studies , ABT. Associates , Inc., 
Cambridge, MA, 1974. 88p . ED 134 620. 

Conducted on over 3,000 fourth, fifth,^. and sixth grade children in 
six states, this study documents changes in nutrition-related know- 
ledge and behavioi^s which can be related to participating in the % 
Mulligan Stew television series. The case studies which comprise 
this volume function as a brief organizational analysis of the Mulligan 
Stew effort at six sites. The six case studies were structured to 
examine several components of organization within the | constraints 
imposed by retrospective data. These components included! (I) % 
examining the planning and training activities related to each site; 
(2) describing the delivery effort and activitijes undertaken by 4-H 
extension staff, along with problems encountered; and (3) assessing 
all costs associated with the Mulligan Stew program. This case study 
analysis, while sc^ft, c:an provide useful data on teclmiques to improve 
delivery f cost in relation to numbers of children re'^ached errors to 
avoid , and ac t ivi t ies to encourage - 
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Sharroan, Heather and Dorward, Geotge. Evaluation of the Manitoba Schools 
Comfxuter Network, AEDS Monitor vl3. nlO, p6-^. May 1975, EJ 119 715. 

Article describes the results of the evaluation of the Manitoba 
Schools Computer NPtwnrk. 

.% . * . « . 1 

Silverstein, Leonard. Project Turnabout, School Year 1975-19?6 . New York 
'City Board of Education, Brooklyn, NY, pffice of Educational Evaluation 
1976, 14p. ED 142 640. ' 

Students in this remedial reading program were given a chance to 
"turnabout" through the use of innovative materials and methods used 
in the program. Remedial instruction in reading and all the language 
arts was provided. The program utilized three paraprofessionals . 
The Rahdom House High Intensity Training System wa^sed with 180 
fourth through sixth grade students selected to participate in -fc-lie 
program because they were at least six months below grade level in\ 
reading. The Metropolitan Achievement Tes.t was administered durijig thje 
first and last week of the program as a diagnostic and assessment ) 
instrument. This evaluation report concluded that students in the 
program increased their reading performance as measured by the 
Metropolitan Achievement Test. Also, students used library resources 
more than they had the previous year and expressed favorable attitudes 
•tov^rd the program staff. The Reading Attitude Assessment Scale used 
for t\e evaluati^ is included as an appendix. 

„ ■ . . ■ ■ r 

Singer, Frank A. Si-if-InsjM;^^^ 

Account ing — A M/_an s \q thejj^emonst^rat ion of Pay-Off s from tndivid ua Tizing 
Tuiie-to-Coiiiple.t^, Fnnai Rop ort. Massactmse tts University^ AirihersF. ^ 
School of Business Adnunistration, 1972. 389p. ED 082 29fL. 

I 

The niaterials in this report provide a case study of ithe development 
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and validation of self-instructional lessons on foi*r 
included in a first college accounting course. For elach topic, 
performance objectives were embodied in four criterion test?. The 
author provides d»ruments^ relating to departmental curriculum decisions 
ar^d to a personnel gr ievance that hampered the projedt. The project 
evaluation was accomplished by^ teaching elementary accounting both 
conventionally and by the ^)^stem employing sel f-ins tifuct i onal mate- 
rials during, ont^ semester and then comparing .the performance scores 
(^f treatment ^^.roups on a number of suf)tests by analy.^is of varianc:e. 
Acc^ording to tlw report, those students who used t he sel f - inst rue t iona 1 
^^^^'l^^^^l^*^ did si^gnif icantiy better on subtests than did the convention- 
.._*i-ny tnught student s . The complete sel f --instructiona I materials and 
tests are contalnc^i in thc^ ciocument , 
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Sohn, David A. and S tucker,^ Melinda. Film Study in the Elementary School ; 
Grades Kindergarten through E^ght> A Curriculum Report to the ,.^erican 
' Film Institute . Ev*is ton School District 65, LL,,1969. 290|)^.^ED 032 316. 

The first, and major portion of this, report of a filci study project 
> in Evanston lists films selected for use in grades 1-8, together 

with plot sunanaries of varying lengths special uses for the films, 
suggested study questions and. activities , sample student reisponses 
to questions and assignments, running times, appropriate age levels, . 
and .sources for ordering the films. The results of ah evaluation of 
the film program as determined by questionnaires distributed to 
students and teachers are presented in Parts Two and Three., A brief 
conclusion on the overall response to the progi^am and the addresses 
/ of film distributors conclude the publication. 



Sovik, Nils, Individual Instruction in Norwegian (The Podin Project), 
Sc andinavian Journal of Educational Research v21, n4, pl97--232. 1977 . 
^ 4 EJ 177 005. y \^ 



As the principle of .integration instead of segregation has become 
dominant iit the planning ^nd organization of the Norwegian school 
(1st 'to 9th grade), different kinds of individualized instruction 
have been recommended to the teachers to use. This^ study investi- 
gates whether, and to what extent, an experimental program of 
individualized instruction within an ordinary school class would 
improve students' performance in oral and written Norwegian com- 
. pared with traditional iristfruction. 



Speedle, Sfuart M. and Sanders, Susan. Data Management & Declsion^Making . 
Technical Repor t No. 1 4. Northwest Regional Educational Laboratory, 
Portland, OR, 1974. 208p. ED 135 058. 

\ '^Data Management and Decision Making'* is a set of instructional 
materials designed to teach pra.cticing and potential educational 
administrators about the uses of operations research in educational 
administration, It consists of fiv^ units— "Operations Research in 
Education/' \'PERT/CPM:'j A Planning and Analysis Tool," ^Linear Pro- 
graTmning/* "Queueing Theory," |and "Computer Simulation.". The firsts 
* unit is 'an introduction. Each of the subsequent four units intro- 
duces a specific operations, research technique and provides instruc- 
^tion on the basic terminology ^and skills involved in the technique^ 
•^'hese materials were subjgjted to extenalve testing and revision -a^ 
part of the developmental project. The evaluation Included a needs . 
assesa«ent^, field testing, ancf cost-benefit analysis. Information 
on the' evaluation is included along with the- needs assessment ins t ru- 
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State Wide ^€^feonstratlon-Dlssemlnatlon of Drug Education Materials throuj2;h 
a Training :6^teis and Local School Workshop Experiences > Narrative Evalu - 
ation . 1975, 26p. ED 151 649.**. ' ' • • 

This evaluation tested the effectiveness of a drug education progr-ain 
. among primary and interjnediate level studenfc in a Wisconsin area. 
•While, the outcomes of this report are .significant to educators in 
Wisconsin, the specificity of methodology and instrumentation is of 
potential value to other groups wishing to determine the effective- 
ness of their own drug education programs".' 

Stefanlcf^, Gilbert Albert , An Evaluation of Achievement and At titudes>#^f 
Students and Teachers Using an Individualized Spelling Approach' , Ed.D. 
dissertation. University of Pittsburgh, 1976- 140p, Available " from Ujiiver 
sity Microfilms, P. 0. Box 1764, Ann Arbor, MI 48106 (Order No. 76-19, 935) 
ED 12? 6;.3.* 

In order to assess the effectiveness of the Continuous Progress in 
Spelling .program, an Individualized approach to spelling mastery, this 
study investigated the relationships among grade level, reading 
^ ability, spelling achievement, and attitude changes in third- and 
fourth-grade participants in the program. A total 6f 689 students 
from five elementary schools in Kent County, MD, were tested on 
spelling achievement , ^reading ability , and attitudes toward spelling. 
The experimental group, coflfsis ting ,of 323 students, then received 
individualized spelling instruction according to program specifica- 
tions. Posttesting revealed significant differences in achievement 
between grade levels. and treatment groups. Across all l^v^ls, 
students in the experimental group showed greater spelling \bili ty 
than did those in the traditional spelllngf program. The facc\that 
both teachers and students showed more positive attitudes toward 
'spelling in the expet i^mental 'situat|.on suggests a possible relation- 
ship between those attitudes and spelling achiclveifient . 
^ ■ ■ ' 

Stevens, R. and others. AI MLO; Auto^-Instru c tional Media for L ibrary 
Or ientat_ioji _ J''j._rTa^,l^ J<epo_r r . ^ Colorado State University, Ft. Collins, 
LYbrarieV, 1974." '2 7p"; ED 105 882. 

In OctDber^ I97U AIMLO (A"ii to-lns true t ional. Media for Library Orienta- 
lion) was ' ini't iat ed at Colorado St^tQ University Libraries. A1M1.0 is 
an innoyar Ivo approach to unds^rgraduate library instruction, providing 
,on-defi!and , point-c^f-use progjrams about three basic library tools: 
periodical indexes, the card ca talog , and U,S. governmant documents. 
To kfH'p student usagf^ of AIMI.O on a strictly voluntary basis, three 
•unobtrusive evaluation techniques wi^re initially tried: counters on 
the machines to record ^ise totals, opti(V;al qut^t^'t i onna i res , and a 
telephone s^^rvi^y. When thesc^ rc\sul.ts proved insu f f i c i en|^ It was 
' '■ decided to evaluate AI>flX) instruction by means of a libr<^y use quiz, 
administered to thret^ sections of an i n t roduc tory psycho logy course 
in the fall of 49/'3'. Section 1 of the class was encouraged to use/ 
ArML(^ for library o/ientation, section 2. was given print^ed guides. 
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and secition 3 received no library Instruction. One week later, the. 
unannounced qui2 was administered* Fifty-two percent of the 502 



Stice, James E, Expansion of Keller Plan Instruction in Engineering and 
Selected Other Disciplines: A Final Report , Texas University, Austin, 
Center for Teaching Effectiveness, 1975. ISOp. Available from autfior, 
Center for Teaching Effectiveness, Room 2404, Main Building, University of 
Texas, Austin, TX 78712. 

The Alfred Sloan Foundation Personalized System of Instruction 
(PSI) project developed 17 courses in various fields at the Univer- 
sity of Texas from January 1, 1973 through Irecembei:^^^Y ^975 . Data 
collected on comparisons between PSI students ^ni^^jf^wtj^^ students, 
indicated that: (1) PSI students learned a^ much or more than , ; 
others; (20 higher PSI grades in this study were not justified; 
(3) PST a^iitients did not do better in subsequent courses; (4) the 
majority/of PSI students 'improved their study habits; and (5) 
knowledgeable teai^liers can utilize well-developed PSI material in 
other locales. It was also found that if proctors were paid, PSI 
course costs were higher, than for conventional instruction. If 
proctors were not paid, only the first units cost more. Further 
cost studies were recommended. An easy first unit, weekly reinforce- 
ment, and rapid course revision were recorauended to minimize student 
procrastination. 

Stice, James^E. Seventee n PSI Projects at the University of Texas at 
Au stin , Paper presented at the National Conference on Personalized Instruc 
tion in Higher Education, 1975. lOp. ED 108 665. 

Progress on the University of Te;scas t^ersonalized System of Instruc- 
tion (PSt) Project is described. IVelve courses in the College of 
Engiueering and five in other colleges were developed for PSP' under 
a grant from the Alfred P. Sloan Foundation. Each qf thbse ^ourses ^ 
has now been offered at least once, thus making it possible tX? ^^?>^^ 
c^valuating the progr^Ci. • Nin^iques tions on the effectiveness, 
efficiency, student and faculty acceptance, and longer term utility 
of PSI are discussed. - " ^ 




Stocker, H Robert and others. MOE; A Progress Report on Mobile Simula- 
tion/ Jo_urna_l oj Business Ed_^^^_^A°J\ ^"^^^^ p52-53. Nov 1970., EJ 028 863 



The feedback from former students, the enthusiasin of the present 
students, and the favorable admin I i?trat ive attnosphere make Mobile 
^Of flee ' Education a program which will definitely expand in the^ 
future. - ^ 



A Summary of the Formative Research Conducted on Pilot Shows 02 and 03 ^ i 
Produced by Bilingual Children's Television . Billngaal Children's 
Television, Oakland, CA, 1973. 153p. ED 086 180. 

A research project ii>vestlgated parent and teacher perceptions of 
the appeal and utility of two bilingual children's television shows 
and studied the appeal and. comprehenslbillty of the shows to children. 
A total of 250 parents, .^44 teachers, and 800 children in eight cities 
responded to questionnaires. Returns showed' that better than 90 
percent of the parents" had positive attitudes toward the programs and 
felt that they fostered cross-cultural upd^ratandlng. More than 80 
percent of the teachers sampled considered the shows useful, reinforc- 
ing to their curriculum, and appropriate for children through grade. 2 . 
Almost 99 percent of the children liked the shows, and test results 
showed that the content was 75 percent comprehensible and that if 
^ promoted language development. It was recommended that additional 

research be undertaken . to establish the programs' long-term learning 
effects, their utility in the classroom setting, and the learning 
differences which occur between gi^oups of children who have been 
exposed to the programs and those who have not. 

Suppes, Patrick and Morningstar, Mona. Computer-Assisted Instruction at 
Stanford, 1966-68: Data, Models^ and Evaluation of the Arithmetic Programs • 
Stanford University, CA, Institute for Mathematical Studies in Social ' 
Science, 1972. 533p. Available from Academic Press, Inc., Ill FiftWAve., 
New York, NY 10003, . ED 070 246. * § 

\ . 

The 1966-68 Stanford mathematics programs in computer-assisted 
instruction (CAt) is reported in this book. The first pert describes 
in detail the 1966-68 - arithmetic drill and practice program which 
followed the similar program run in 1965-66. Part II describes the 
tutorial program in first and second j^rade mathematics at Brerttwood 
School in East Pal5 Alto, Eath of the two parts emphasizes three 
main aspects of the program: the curriculum, the operation of termi- 
nals in scho.ols, and the behavioral analysis of student response 
data. An introductory chapter considers some of the issues raised 
by CAT and overviews the operation during 1966-6&, Sections in the 
first part describe the curriculum and students, regression modois 
and response data, automation models of student performance, and 
data on learning' and evaluation. Sections in the s^^ond part cover 
the.Stanford-BretUwood Laboratory and program, the ^rrlcuium and 
operation of the laboratory, analysis of response data, and anal^ysis 
of individual student data. Appended ar^^ more detailed supplementary 
f mater la Is . 

Tamir, W ami Amir, R. Ti^aching Sc^ience to First and Second .Crade Pupils 
in Isr.u^I by i\\c Aud i o-Fu t i a 1 Method, Sc ience_ Kd_ucat i o_n v^9, nl, p'i^}'49. 
.Jan-Mar FJ 121 40'K . " ," 

^ ' , ■ 

Rt^porrs the extent to wtiich aud"^)- tutorial United States science, 
programs can be adapted ^for Israel, effect of maturation on pupiTs 
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learning, effect of socio-economic status of pupils, effect of 
classroom compositi6n, achievement differences between boys and 
girls, and benefit of using different modes of ^^rformance for 
student evaluation. 



Tatham, Elaine L. and ethers. Evaluation of College Learning Center 
Instruction In Six Subject Areas, Spring 1975 . Johnson County Community ^ 
College, Overland Parks, KS, 1975. 31p. ED 110 141. . . 

This study evaluated the success of Johnson County Community College's 
College Learning Center (CLC) in helping students - to improve specific 
skills in six areas — spelling, vocabulary, English, mathematics, 
reading comprehension, and reading rate. The .CLC offers individual- 
ized programs whsich employ a combination of self- instructional 
materials and individual tutoring, bata were analyzed separately 
for the spring 1972~sunmier 1973 and fall 1973-suminer 1974 periods in 
order to detecj;^ any difference in the success patterns of CLC instruc- 
tion. Evaluation was based on- analysis of ;^aitis in performance for 
every student participating during eitl^fer period. The average gains 
represented significant impro^^ement from pretest to'po^ttest in all 
six areas; the improvement was similar for both time periods. Statis- 
tical data Is presented graphically for "each sub j ect . Appendix A 
describes the six courses and their pre- aijd po^ttests. Appendix 
lists supplementary instructional materials for the six, progr^s. 

Thonipscfe, John F. and others. Evaluation of Educational- Television in 
University E xtension Youth Proj^rasming . Wisconsin UniveVsity, Madison, 
College of Agricultural and Life Sciences, 1970. 15p. ED 044 639. 

This study tested the effectiveness, of the 4-H TV action series brpad- 
cast over several Wisconsin commercial statioris for schoo;L children in 
grades 4-6. Data were sought on patterns of participation, effects of 
related classroom activities and personal maturity on learning, and 
the extent to v^hich youth can learn about emergency p^reparedness • 
^ through television. In addition to broadcasts in 16 western Wisconsin 
counties beginning in January 1967,. the program was televised on 

■ . .. Saturday mornings in the fall by commercial stations#»in Green Bay, 

"*"^ilne lander, and Wausau. Teachers in Lacrosse Count^^ adminis tered . 
pretests and posttests and agreed to discuss each program in class 
and to have the students complete' the suggested projects. (Teacher 

^ respronses and university extension agent reactions included data from 

a much wider area.). These were among the conclusions reached: (1) 
university extension can use educational television (ETV) effectively 
with grade 4-6 children during nonschool time; (2) they will view ETV 
• and learn -from it; (3) grade 4 pupils like the program better than 
grade 5 or 6 pupils, but the latter learn more; (4) supplementary 
classroom activities tend to increase learning; (3) teachers respond 
favorably to ETV pro.^XiiW' and"\/lll use them. 
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~;.Tira, Danial Edward. An Introduction to the Theory and Appilcat:iQn'\!)f "Che, 
■ • ?roduct-Moipent Family of Cdrrelatiohs via a Computer Assisted Instructional 
Sy^|pm. Ohio State University, Columbus, College of Education, 1970. ~ 
22^p. Available from University 'Microfiljas^30^North Ze^eb Road, Ann Arbor 
MI (Order No'. 70-19, 372). ED 052 62^^.* ' . ■ * 

A developmental study was c:onduct;^d to produce a computer-assisted 
instruction (CAir program dn the product -moment family of correla- 
tions. The first phase in the development was the definition- of the 
requirements of the developmental process which serve as guidelines • 
'In the design phase, the specific topics to be^treated In the program ' 
were compiled and expressed^ in narrative form/ The production phase 
-CransforraBd the narrative of the design sfage into an interactive 
) dialogue characteristic of CAI. An evaluation phase sought to - ^ 
determine the conceptual inadequacies of the progilsun' and its eff e^r 
. tiveneas in presenting the statistical concepts. Teh student^ 
; -reviewed the course and coi^pleted ^n evaluative questionnaire. These 
, students were divided into three classes, depending cxn thgir level 

of understaloi^ing of fundamental statistical conc^fepts. The CAI course ^ 
proved effective for the two Ipwesfc classes of students, although- 
certain of the concepts in the program were IdentiH^d as being 
unclearly presented. ' ^ 



Topical Modules in Secondary Mathesiatics . . Final Project Report . Fresno ' 
City Unified School District, CA, 1^3. SOpT Available from fiRIC/ SMEAC , 
The Ohio State University, 400 Linccfln Tower, Columbus, OH "43210 (on loan). 
"ED 107 478,* ^ ■ 

Summative evaluation of an ESEA. Title III project designed" to raise 
, ^ the mathematics achieyement scores of low achievers in -grades 10 and 
ll^J^ reported. In a summer wrdt^g project , teachers developed 21 
tnmBtJ^ modules and 11 algebra modules for uae by students on an 
Tual basis. Students used the modules at their own >ace and 
with a module until criterion- performance was achieved. 
Luation was basred on pretest and posttest scores on thfe Comprehei\- 

Tests of Basic Skills JCTBS) , Foirm Q, Leyel 4, and an attitude 
^ey instrt^ment developed by the project; cojcparisons with a 
control group werp made^ The objective of raising CTBS 'scores by 
1.2 months pgr ironth in the program was achieved for the algebra 
modules group, but not for the total group. There was no significant 
diffcrt2nce between the gains on CTBS total score made by experimental 
and control groups,; there werejt however,, some differences on subscale 
scores. Experimental sLtudenDs 'had a .more pes It'ive attitude toward 
mathematics at the time of posttpstlng than at pretesting, while the 
reverse was true for controls. 

^ ■ ■ ■ ' 

Trojrak, Doi*i.s A, Training in ^ogrammi^ng Instrucfion and Student Arhirvr- 
meuL, Journal'of Research in .'^ iencc Teaching vi-ii ni , p3y-4A. 1.9/4. 
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Reports the results of a study 'designed to determine th« influence of 
five -stages of Instruction art the prospect'lv^ teacSiers \ ab i 11 1 y to 
construct programmed science activities for fourth p,rade students. 
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Uthe,^ Elaine F. ^sQessing the Teaching Ef fectiveoess of an Audio-Visual 
Program Relating to the Intensive Office Program in Business Education ; 
1977. Up. ED 155 191. - . ' - ^ 



The effectiveness Qf h teacher-made slide-^-tape presentation for 
training experienced business teachers to* teach the Intensive Office,/ 
Program (iOP)~a-high school course, incorporating office practice, 
o'fflce machines^ advanced typewriting and shorthand — was field 
tested. Three group's vere Involved: undergraduate «non-busiftess 
education students / undergraduate business education students, and 
graduate ^siness education teachers enrolled in the 1976 stumoer 
course to^become lOP teachers,. All were^ given a 43-lte^ true-false 
quiz and written guidelines for lOP, before and aft^Pvlewlng the 
presentation, Pretest-posttest differences were , slgniflcan|i, foj 
all three groups/. Item analys*is was made to identify test items 
needing revision. Those ,15 concepts answered incorrectly by at 
least 20 petcent on the postte§t w6re review^ed *f or slide and script 
clarity, as well as test item cantrent. In cdhcluslon, the present 
slide-tape was foufjd to be effective, but certain areas needed 
ImprovemdJttt . Additional development is recommended. 
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Valencia^ Atilano A'. The Relative Effectiveness of Three Video Oral 
English Inst;ructl'onal Conditions for Illiterate or UYidereducated Non- 
English Speaking Adults., Spanish Speaking Adults. A Report of Statistical . 
Findings and Recoromendatlons -Based on a Field Testing Study . Soutl>Western 
Cooperative Educational Laboratory, Albuquerque,-. NM, 1969^ 65p. ED 050 615. 

% • » - 

The instructional effectiveness of video taped^lnst ruction in basic 
oral English to non-English speaking, adulf^speakers of Spanish is 
the'focus of this repc^rt. A field testing program involvfng subjects 
who Wd been exposed to the films developed by the -^Southwes tern Coopera^^ 
tlve Educa'tlonal Laboratory ascertains the effectiveness of the lessons 
in each of the films in terms of predetermined behaviorial objectives. 
Three testing condition^ were envisaged and are ejcamlned in this study: 
a classroom condition with video exposure only; a classroom 'condition 
with video exposure and foMowup drills by an Instructor; and a home' 
condition with' video exposure only. This' four-part report covers: 
(1) principal features of the field testing progr^am, (2) criterion 
variables and statistical deSigij, (3) statis.tlcal analysis and fiiuiings, 
and (4) sumniary^ conclusions, and recothmendations . Appendices contain 
a sample field ^testing instrument and various statistical tables. 



Van Wart, Geraldinc. Ca rrascol e ndas : ■ KvalS 



i o n of a Spa n ish/Engl isH 

Fi nal Report . Evaluation 



Educational^ Television Series wi thin R e gion XI 

Component, Education Service Center Region 13, Aus\ iu, TX, 1974 
ED"092 089 



.234p. 
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•This fourth year evaluation reports the effects and usage of , 
''Carrascolendas a children's television series in Spanish and 
English. Research was conducted in Texas schools and .BH4:otnpassed 
three phase's: a field experiment to measure learning efffects; 
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attitudinal surveys among >teachers^ parents^ and children; and a 
process evaluation of the Education Service Center Cartascolendas 
staff members. The field experiments consisted of viewer and non- 
viewer groups of Mexican-American children, grades K-3. Criterion 
referenced instruments designed in Spanish and English were adsinis- 
tered which compared viwer and nonviewer scores. Combined viewers 
made a "signif icant gain score increase in the Spanish areas of his-i 
tory, . culture, and reading; and In the English areas of history, 
culture, and science. The content areas which had the least impact 

, in Spanish and English were matft and self-concept. Survey elicited 
"Attitudes indicate increased improvement in the use of Spanish and 
English by children and greater pride in the Mexi can- American 
culture. Attitude iteiQS on which viewers ma§e slgnifkiant gains 
over noftviewers dealt with speaking Spanish and teacher approval 

. of school work. The process evaluation sunmarizes activities and 
describes the services and interaction which were provided . ^ ^ 

Vaughn, John W. and Duncan, Robert C. Evaluation of Merrimac;J$; Edtvcation 
Center Project League 1973 . Indiana University, Bloomington, Center for 
Administrative Studies^ 1973. I84p,. ED 114 367. 

This report presents an evaluation ^tudy of Project League which is 
currently implementing Individually Guided Edu'cat.ion (IGE) through 
the auspices of the Merrimack. Education Center in Chelmsford, MA. ^ 
Th^ purpose of tfie evaluation was to tieterniine t|iie degree of IGE 
goal-oriented impact t?hat Project League has had on participating 
elementary schools relative to (1) IGE outcome achievement, (2) 
TOE role perception congru^^ncy, (3) Project League activity orienta- 
tion, an^ (4) identif icaCion of successful practices in participating 
schools. The ilrst two sections of the report discuss both tlie out- < 
com^ achievement questionnaire and t+ie role clarification questionnair 
These sections contain descriptions of the ins truments ; information 
concerning administration, scoring, and the population; and. analyses 
of the data. The. following section contains the computer ' analyses . 
Stude'nt interview results are discussed in the next section which 
consists of representative replies given to specific questions by 
the interviewees. A discussion of the on--site observations of league, 
schools is the topic of the following section* The last three sec- 
tions include preliminary and final recommendations, as well as a 
list of the successful education 'practices of the league" schools . 
Six appendices containing the proposal^ questionnaires, the interview^ 
schedule, and the successful practices by schools complete this report 

Vincd, Thomas G, and DeVita, Christina. An Evaluation of the State Urban 
Education Program ''Living Science Center.*' District 10, Ne w^York City 
Board of Edu ca tion . Fordham University, Bronx, NY, 1970. *16p. EU 059 881 

A program of stimulation, motivation, and cultural enrichment for 
children In New York City's School' District 10 is evaluated in this 
report. The Bronx Zoological Gardens were fised for living laboratory 
experiences, coordinated with classroom activities in different curric 
ulum areas. Employing zoo visits, lectures, films, and clasacoom 
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des^nstrations, the Living Science Center program^reached over 800 
fifth grade atudenta. " Effectiveness of the program was evaluated- vith 
three instruroents: interviews with students, questionnaires to teach- ^ 
ers, ^d observation. Findings from the evaluations are reported under 
the following topics: (1) project toaterlals and implmentitlon, (2) 
prograaa observation, (3) personnel evaluation of the program,^ (4) 
student reaction^to the program^ (5) post-projgram Xest results, and 
(6) program coordination and administration. R^ecommendations for 
program continuation and Improvement kre also given. 

Visual Concepts Program: An Evaluation Report . Phoenix Union High School 
District/ Arizona Department of Research and Planning, 1977. 18p. 
ED 129 872. 

Startitig with the second semester of the 1971-72 school yea!:, the 
Phoenix Union High School system accepted a performance contract 
with ^Educators Service Incorporated of Edina, MN\ .The contract 
enabled the district to implement « one-semester ^rogrami which was 
a multimedia course consisting of 36 30-minute videotaped Sessions 
which were divided into eight skMl progression phases: initial 
test^iTg^ preview skill, recall skill, learning techniques', re- focus 
and review evaluation, memoiry skills, vocabulary and depth reading 
skills, and achieven^nt tests and evaluation. The perfonxum'ce con- 
tract jguaranteed certain increases in reading rate and reading com- , 
prehension. These guarantees were not entirely met, but there was 
significant improvement in these reading skills, and the evaluatJ^on 
report recoimaended the purchase of the videotapes used. 

Vocalyulary Development Project. Evaluation Report 2 . St. Louis Public 
Schools, MO, 1971. 56p. ED 059 838, - , 

The St. Louis Vocab^lary Development Project was developed to help 
children cope with the increasing vocabulary* demands in cpntejit area 
textbooks encountered In the. fourth grade. The project was presented 
over the school radio system for 30 minutes daily, three days i^eekly, 
for 30 wfeeks in abt^ut 150 schools. The fifth "knd sixth graders were 
taught 1,800 words, and the, fourth graders received 585. The Iowa 
Tests of Basic Skills and the Lorge-Thorndike Intelligence Testsjf'^ 
were administered before and after fhe project. Test results were 
factor analyzed and correlated with gains . in' vocabulary development. 
A teacher questionnaire was also administered. It was found that 

(1) the , Vocabulary Development Project had, positive effects on 
measured ' achievement growth in general vocabulary and spelling; 

(2) it had a small, but positive, e^Jffi^ct on measured changes in 
reading achievement and intelligence;' (3) the effects on achievement 
variables were greatest for stujients in predominately black schools; 
and (4) teachers generally favored the project. Tables and references 
are included. 
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Vocational Campus Multimedia Learning Laboratory Program-Extjifcsion. VEA 
Project Number 72-2-179. Fdnal Report . State University of New York, 
Alfred, Agricultural and Technical College, 1972. 30p. ED 079 476. 

A multimedia learning laboratory program was developed at 'a post- , 
secondary vocational campus to: (1) provide help in reading, math, 
and study skills for students with inadequate educational back- 
grounds, (2) provide a means by which students may enter a Arogram 
at times other than the start of the school year, (3) facilitate 
articulation of students from secondary vocational-technical pro,- 

frams, and (4) provide for student self-development. This publica- 
ion discusses the development of the facility along with a discus- 
sion of the sta^ffing, ptogram development, and development of 
curriculum oriented materials. An evaluation of the program by 
^students and faculty revealed that: (1) the number of students 
utilizing the laboratory increased 37 percent over the first year 
of operation, (2) over 70 percent of the students felt that their 
' experience in the labdratof y had made them more confident and had 
improved their academic standing, and (3) over 80 percent of the 
faculty felt that their students had benefited from the laboratory- 
A listing of the laboratory equipment and software along with 
student and faculty .evaluation questionnaires and tabulations is 
appended. 

Welnstein, Sanford. Diagn os tic and Renaediation program to Ameliorate the 
Readi ng Disabilities of JHS CRMD Pupils, February-June, 1975. Evaluation 
Report . New York City Board of Education, Brooklyn, New York Office of 
Educational Evaluation, 1.975. 25p. ED 136 487. 

Evaluated was a project designed to provide a supplementary individu-- 
alized reading remediation program for 1,221 educabie mentally 
retarded students (12-16 years old) from' 41 intermediate or junior 
h^.gh schools in New York City. The project goal was to diagnose the 
reading disabilities of the students, raise their level o^ reading 
proficiency, and ameliorate th^ir reading disabilities. Teaching 
methods included one-- to-one and small group instruction, and the use 
of multisensory instructional materials and equipment. Using pre^ 
and posttest evaluation, it was determined that student participants 
\r\ the program succeeded in raising their levels significantly beyond 
the level anticipated had they not participated. .It was also found 
that diagnostic procedures were universally applied and utilized. 
And finally, it was found that delays in funding shortened the 
treatment period, and that difficulties in hiring prevented much 
■ contribution by psychological support personnel to the success of 
the program. The aspects of ^ the program which were observed to 
account for thelilghly positive results were the individually tailored ^ 
remediative efforts made possible by small group and one-to-one instruc 
tion, and the. skill with which teachers executed both diagnostic and 
remediative tasks. 
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Weiss, James. More Advanced Reading Development » 1975-76 School Year , 
ke\j York City Board of Education, Brooklyn, Office of Educational Evalu-- 
ation, 1976- lip^ ED 142 631. 

This report evaluated the advanced reading program designed to enrich 
reading instruction for 360 junior high students in- New York City who 
were reading two or more years below grade levels Stud^ts received 
^ individualized reading instruction fdr ioiix 45-minute periods per 
week. Students were pre-tested" in October 197>*and posttested at 
the end of March 1976. As a result of participation in the more 
advanced reading development program^ seventh graders achieved a . 
mean reading grade growth of .11 /months, and ninth graders achieved 
a mean reading grade growth of .26 months. The report concluded that * 
students in the program did progress beyond their recorded entrance 
achievement. However, pnly the seventh gradersf.progressed'^ beyond 
their expected achievement scores. 

Willdams, Frederick and Natalicio, Diana S. Evaluating Carrascolendas ; A 
Television Series for Mexican-American Children. . Paper presented at the 
annual meeting, of the American Educational Research Association, 1972. 
19p. ED 062 367. 

' The development of "Carrascolendas," a television series designed 
for Mexican-American children, is summarized. Emphasis is placed 
upon strategies for 'evaluation. Evaluation evidence indicates that 
"Carrascolendas" may be an- alternative ^r an addition to the Sesame 
Street approach to dealing with the education of the disadvantaged. 

Williams, Frederick and others. Carrascolendas; National E valuation of a 
Spanish/English Educational Tele\fision Series, final Report , texas Univer- 
sity, Austin, Center for Communication Research',' 1973. 416p. ED 078 679. ■ 

♦ 

A field experiment, attitude surveys, and a process evaluation were 
donducted in order to evaluate the third year of Carrascolendas, a 
kindergarten-second "grade bilingual series carried nationwide on the 
Public Broadcasting Service. Test scores showed that material pre- 
sented In Spanish had a significant impact on learning in history 
and culture. First graders showed marked improvement in English and 
.Spanish language skills. Several content areas were affected: history, 
culture, English and Spanish language skills, and math. Second graders 
benefited least, showing significant gains only in the Spanish content 
' area of history and culture and In English fluency. There was little 
impact upon the Spanish content areas of science, phoneme /grapheme 
relations, and language mixing. Attitudes of teachers, parents, and 
children toward the series were positive, and a growth of pride in 
Mexican culture and increased use of the Spanish language were noted. 
The process evaluation found improvement in the management of the 
progtam, although insufficient dissemination of information about the 
series to potential viewers was regarded as a salient shortcoming. 
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Williams, William Watts . An Experiroentgl Investigation of Individualized 
Instruction in the Teaching of Quantitative' Physical Science . Duke Univer- 
sity, Durham, NC, 1969. lOlp. Available from University Microfilms, 300 
North Zeeb Road, Ann Arbor, MI 48106 (Order No. 7,0-8839). ED 052 015.* 

An inveistigation of the effectiveness of individualized versus group 
instruction in ninth grade science is reported. Six classes were 
matched on the basis of Lorge-Thorndike Nonverbal Intelligence Test 
scores and placed into three groups: control, experimental, and 
reference (talcing a different science course) . The conclusion was 
that i«dividualized instruction was more effective than group instruc- 
tion for achievement, retention, amount of activities completed, and 
positive student attitudes. • . 



Wolf, Judith G. and Sylves, David, Evaluation of a Bilingual Television 
Series, Villa Alegre: Final Report . State University of New York, College 
at- Buffalo, Educational Research and Development Complex, 1974. 65p, 
ED/'103 511. 

The purpose of this ev^iuati.on study was to determine students' and 
classroom personnel's p'erceptions of and reactions to "Villa Alegre'' — 
a television series produced by Bilingual Children* s Television, Inc- 
and shown in various locations in the U.S. during the fall of 1974 — 
when utilized in a classroom setting, in order to ascertain whether 
the use of this series would be a wprthwhile addition to bilingual 
classrooms. There were 135 student and 23 adult participants in two 
bilingual suinmer schoftl pra^jects. The<^TV series consists of five 
strands ea^h containing 13 video taped programs. A learning guide 
is available for each program. Three surveys, written by the research 
drs, were ut^ilized in the study. These questionnaires were translated 
into Spanish, The pupil evaluation instrument was administered itwice 
during the study: after the children had viewed four tapes (pupil 
evaluation 1) and again following the fifteenth tape (pupil evai^u- 
ation 2). Reac^ons to each individual tape were elicited fi^6,in class- 
, ' -. room personnel immediately after the tape, had been viewed in ^the 

classroom and reacXions to the total series at the end "of the summer 
session. The responses from these suA^eys were extremely positive. 
On this basis, it ^' would seem that the use of this series would be a 
worthwhile addition to bilingual cl^^ssrooms. ' 



\- ■ Wolvek, Joseph. B read and Butte r flies: Evalua tion of the lEBN-DPI Iowa 

Educatiotial Broadc a st ing Network — Department of Public Instruction 1974-7 5 
Inservice t raining W or ksho ps. Iowa State Dopartmen^t of Public InstructTotgi, 
Des Moines, 1975, hip. ED 114 493. 

i- 

i'he documenl presents a discussion and evaluation of the training 
workshop program developed by the Iowa Educational Broadcasting 
^ Network and the Iowa State Department of Public Instruction to help 

teachers incorporate the Bread and Butterflies television series on 
career developmerTt- into fourth, fifth, and sixth grade curricula. 
The Bread and Butterflies series Ik described as a quality product 
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witl^ extensive training aids, including a comprehensive curi?iculuia 
guide, individual program analysis, before-viewing readiness plan, 
program susamaries, and suggestions for classroom discussion and' | 
activities. Workshop goals included informing teachers of the pro- 
gram and its content," incorporating if into existing curricula 
throughout Iowa, and fostering a positive teacher attitude. A one- 
day, inservfbe t^^jiining workshop was developed f0r 14 regions of 
Iowa. A group of teacher trainets selected by region from school 
systems throughout the state received the training and, in turn, 
provided inservice training to faculties in their respective school 
systems. Evaluation was made of the teacher trainirfg workshops, 
career development attitude jif upper elementary .teachers, and cost 
effectiveness* A detailed disctission of evaluation findings is pre- 
sented, and tables and figures supplement the material. 

Wood, Dean A. The Develnpment and Diagnostic Evaluation of the Monte Carlo 
Integration Oftmputer as a Teachigg Aid . Paper presented at the annual , - 

meeting of the National Association for Research in Science Teaching, 1972. 
16p. ED 065 303. * , 

* ^ *» 

This document outlines the operation of the Monte Carlp Integration 
Computer (MCIC) , which is capable of simulating several types of 
chemical processes. Some data obtained through the MGIC simulation 
of physical processes are presented in graphs. After giving reasons 
for not using the initially t:onteraplate<i summative research procedures 
for evaluation of the MCIC as a teaching aid, the author chooses to 

- use a diagnostic or formative evaluation./ Evaluation occurred over 
three lecture/demonstrations of the MCIC to high school chemistry students 
in Philadelphia. Sample problems from one problem area—understandixig 
the presentation of Che MCIC — are presented to illustrate that J>rma- 
tive evaluation of instructional materials pight be more profitable 

than nwre traditional evaluations'. 

Woods» Nancy A. Instructional Development Services ; A Project Evaluation .. 
Kalamazoo Valley Community College, MI, 1978. 35p. ED 154 886. 

^The Kalamazoo Valley Community College Instruct^ional. Development \ 
Services (IDS) program was designed to provide consultation services 
for faculty wanting to develop and refine instructional strategies; 
to review gfant proposals, award grants, and monitor faculty grant 
progress; and to provide faculty on-campus seminars for specific 
purposes op Issues. An evaluation project was aimed at answering 
four major questions about IDS: what IDS planned to accomplish, 

- what procedures and. criteria were employed in carrying out objectives, 
'what activities and accomplishments directly. resulted from IDS, and 

what impact IDS had on administrators, faculty, and students. Data 
came from a faculty survey,, interviews with grant recipients who had 
finished their projects, interviews with IDS committee members, 
observations, and a review of documents. Although overall IDS success 
was found, IDS plans for 1975-76 were not specific and criteria for 
selection of faculty proposals were not established. IDS primarily 
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affected administrators by increasing the ^ime they devoted to 
instiHictional development activities, and alsp increased fatuity 
knowledge and skills. IDS impact on students was not adecfuately 
measured, although faculty and administrators generally perceived 
students as benefitting from IDS activities, - Appendices^ present 
IDS project implementation processes, evaluation report sujomaxies, 
selected IDS -grants, and an IDS proposal' outline. 




Yamamoto, Toru. Sesame Street around the Wprld: The Japanese Experience, 
Journal of Communication y26, n2, pl36-37. Spring I976, EJ 139 255. 

Suggests thi^t Japanese children's latjc of exposure to spoken English 
poses critical problems^ in their comprehension of the program content 
of Sesame Street- Concludes that these problems are responsibly for 
Sesame Street being treated mainly as an English study- program for*^ 
older students rather than as an educational program fjcjr. young 
children. 
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^achert,' M^r^^ Jane K. and Pantelidis, Veronica. SIBE: A Sequential 
jtn-Basket EXer^ise •Technique , ...Florida State University, Tallahassee, 
Computer-Assist^ Instruction Center-, 1971. 153p.^ ED 056 469. 

SIBE (Spquentiai In--Basket Exercise) is'^a cotnputer-assis ted program 
designed to provide library science students with decision-^making 
experience via simulated library administration problems. An initial 
* problem is presented online by a teletype; it is followed by two " 
derived problems, dependent on the student's initial respfcnse * 
selected from five action choices, A pilot study was planned to 
determine to what extent library science students choose the same, 
decision pathway ^in the resolution of an administrative problem, to 
what extent elapsed time varies among students^iin making these 
decisions, whether such an in-basket exe*rcise would stimulate class 
discussion, and whether library science students would find the SIBE 
a useful learning mode, 'Among the 33 students in the pilot study, 
concurresice^n the pathway choice ranged from one to six students 
per prot/lem, wiLh a mean of l.SS students in'agreement. The total 
■ time for completion of\ the 4-problem exercise ranged from 26 to 63 
minutes, with a mean of '42.9. Considerable classroom discussions was 
generated by the programs, and 96 percent of the students answering 
an affective questionnaire felt that they learned '''some*' or "a lot'* 
from the SIBE. 
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